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When  we  build  a  model  of  real-time  systems,  we  need  ways  of  representing  the 
knowledge  about  the  system  and  also  time  requirements  for  simulating  the  model. 
Considering  these  different  needs,  our  question  is  "How  to  determine  the  optimal 
model  that  simulates  the  system  by  a  given  deadline,  while  still  producing  a  good 
quality  at  a  right  level  of  detail?"  We  have  designed  the  OOPM/RT  (Object-Oriented 
Physical  Multimodeling  for  Real-Time  Simulation)  methodology  as  an  answer  to  this 
question.  The  OOPM/RT  framework  has  three  phases:  1)  generation  of  multimodels 
in  OOPM  using  both  structural  and  behavioral  abstraction  techniques,  2)  generation 
of  the  AT  (Abstraction  Tree)  that  organizes  the  multimodels  based  on  the  abstraction 
relationship  to  facilitate  the  optimal  model  selection  process,  and  3)  selection  of  the 
optimal  model  that  guarantees  to  deliver  simulation  results  by  the  given  amount  of 
time.  A  more  detailed  model  (low  abstraction  model)  is  selected  when  we  have  enough 
time  to  simulate,  while  a  less  detailed  model  (high  abstraction  model)  is  selected  when 
a  deadline  is  imminent.  The  basic  idea  of  selection  is  to  trade  structural  information 


for  a  faster  runtime  while  minimizing  the  loss  of  behavioral  information.  We  propose 
two  possible  approaches  for  the  selection:  Integer  Programming  (IP)-based  approach 
and  search-based  approach.  By  systematically  handling  simulation  deadlines  while 
minimizing  the  modeler's  interventions,  OOPM/RT  provides  an  efficient  modeling 
environment  for  real-time  systems. 


VI 


CHAPTER  1 
INTRODUCTION 


Real-time  systems  refer  to  systems  that  have  hard  real-time  requirements  for  in- 
teracting with  a  human  operator  or  other  agents  with  similar  time-scales.  An  efficient 
simulation  of  real-time  systems  requires  a  model  that  is  accurate  enough  to  accom- 
plish the  simulation  objective  and  is  computationally  efficient  [1,  2].  We  define  model 
accuracy  in  terms  of  the  ability  of  a  model  to  capture  the  system  at  the  right  level 
of  detail  and  to  achieve  the  simulation  objective  within  an  allowable  error  bound. 
Computational  efficiency  involves  the  satisfaction  of  timeliness  requirements  to  sim- 
ulate the  system,  in  addition  to  the  efficiency  of  model  computation.  In  existing 
applications,  it  is  a  user's  responsibility  to  construct  the  model  appropriate  for  the 
simulation  objective.  This  is  a  difficult,  error-prone  and  time-consuming  activity 
requiring  skilled  and  experienced  engineers  [3,  4,  5]. 

Most  CASE  tools  [3]  try  to  help  the  modeling  process  by  providing  an  extensive 
library  of  functions  that  allow  a  modeler  to  specify  numerous  aspects  of  an  applica- 
tion's architecture.  These  tools  deal  with  static  models  suitable  for  producing  design 
documents  with  limited  facilities  for  simulating  the  models,  analyzing  the  results  of 
such  simulations,  running  what-if  questions,  or  translating  the  paper  models  to  pro- 
totype code.  However,  these  tools  do  not  provide  support  for  specifying  the  real-time 
constraints  of  an  application's  functions  [5,  6]. 

Our  objective  is  to  present  a  modeling  methodology  in  which  the  real-time  systems 
can  be  modeled  efficiently  to  meet  the  given  simulation  objective  and  the  model's  time 
requirements. 


1.1     Problem  Statement 

Real-time  systems  differ  from  traditional  data  processing  systems  in  that  they 
are  constrained  by  certain  non-functional  requirements  (e.g.,  dependability  and  tim- 
ing). Although  real-time  systems  can  be  modeled  using  the  standard  structured 
design  methods,  these  methods  lack  explicit  support  for  expressing  the  real-time  con- 
straints [4,  6,  5].  Standard  structured  design  methods  incorporate  a  life  cycle  model 
in  which  the  following  activities  are  recognized  [5]: 

1.  Requirements  Definition  -  an  authoritative  specification  of  the  system's  required 
functional  and  non-functional  behavior  is  produced. 

2.  Architectural  Design  -  a  top-level  description  of  the  proposed  system  is  devel- 
oped. 

3.  Detailed  Design  -  the  complete  system  design  is  specified. 

4.  Coding  -  the  system  is  implemented. 

5.  Testing  -  the  efficacy  of  the  system  is  tested. 

For  hard  real-time  systems,  this  methodology  has  a  significant  disadvantage:  timing 
problems  are  recognized  only  during  testing,  or  worse,  after  deployment.  Researchers 
have  pointed  out  that  the  timing  requirements  should  be  addressed  in  the  design 
phase  [5,  6].  Two  activities  of  the  architectural  design  are  defined  [5]: 

•  the  logical  architecture  design  activity 

•  the  physical  architecture  design  activity 

The  logical  architecture  embodies  commitments  that  can  be  made  independently  of 
the  constraints  imposed  by  the  execution  environment  and  is  primarily  aimed  at  sat- 
isfying the  functional  requirements.  The  physical  architecture  takes  these  functional 


requirements  and  other  constraints  into  account,  and  embraces  the  non-functional 
requirements.  The  physical  architecture  forms  the  basis  for  asserting  that  the  ap- 
plication's non-functional  requirements  will  be  met  once  the  detailed  design  and  im- 
plementation have  taken  place.  The  physical  design  activity  addresses  timing  (e.g. 
responsiveness,  orderliness,  temporal  predictability  and  temporal  controllability),  de- 
pendability requirements  (e.g.,  reliability,  safety  and  security),  and  the  necessary 
schedulability  analysis  that  will  ensure  that  the  system,  once  built,  will  function  cor- 
rectly in  both  the  value  and  time  domains.  Appropriate  scheduling  paradigms  are 
often  integrated  to  handle  these  non- functional  requirements  [5].  The  following  issues 
arise  : 

•  How  to  capture  the  logical  aspects  of  the  real-time  systems 

•  How  to  assess  duration  and  quality  associated  with  each  model 

•  How  to  resolve  the  timing  requirements 

•  How  to  support  both  logical  and  physical  activities  under  one  modeling  and 
simulation  framework  so  that  the  resulting  model  is  guaranteed  to  function 
correctly  in  both  the  value  and  time  domains 

Several  assumptions  are  made  to  answer  these  questions  : 

•  Sacrificing  solution  quality  can  be  tolerated  so  that  the  systems  can  be  mod- 
eled by  multiple  solution  methods,  producing  tradeoffs  in  solution  quality  and 
execution  time 

•  Duration  and  quality  associated  with  a  method  are  fairly  predictable 

1.2     Overview  of  OOPM/RT 

We  propose  OOPM/RT  (Object-Oriented  Physical  Multimodeling  for  Real-Time 
Simulation)  for  aiding  modelers  to  meet  arbitrary  time  and  quality  constraints  im- 
posed upon  the  simulation.  OOPM/RT  adopts  a  philosophy  of  rigorous  engineering 


design,  an  approach  which  requires  the  system  model  to  guarantee  the  system's  time- 
liness at  design  time  [6].  OOPM/RT  uses  OOPM  for  the  logical  architecture  design 
activity.  OOPM  [7]  is  an  approach  to  modeling  and  simulation  which  promises  not 
only  to  tightly  couple  a  model's  human  author  into  the  evolving  modeling  and  sim- 
ulation process  through  an  intuitive  HCI  (Human  Computer  Interface),  but  also  to 
help  a  model  author  to  perform  any  or  all  of  the  following  objectives  [8]: 

•  to  think  clearly  about,  to  better  understand,  or  to  elucidate  a  model 

•  to  participate  in  a  collaborative  modeling  effort 

•  to  repeatedly  and  painlessly  refine  a  model  as  required  with  heterogeneous 
model  types,  in  order  to  achieve  adequate  fidelity  at  minimal  development  cost 

•  to  painlessly  build  large  models  out  of  existing,  working  smaller  models 

•  to  start  from  a  conceptual  model  which  is  intuitively  clear  to  domain  experts, 
and  to  unambiguously  and  automatically  convert  this  to  a  simulation  program 

•  to  create  or  change  a  simulation  program  without  being  a  programmer 

•  to  perform  simulation  model  execution  and  to  present  simulation  results  in  a 
meaningful  way  so  as  to  facilitate  the  prior  objectives 

By  using  OOPM  for  the  sources  of  multiple  methods,  we  can  model  a  system  efficiently 
with  different  model  types.  In  time-critical  systems,  we  may  prefer  models  that 
produce  less  accurate  results  within  an  allowable  time  over  models  that  produce  more 
accurate  results  after  a  given  deadline.  The  key  to  our  method  is  to  use  an  abstraction 
technique  as  a  way  of  handling  real-time  constraints  given  to  the  system.  We  generate 
a  set  of  models  for  the  system  at  different  levels  of  detail  through  a  model  abstraction 
methodology,  and  then  choose  a  model  that  has  the  optimal  abstraction  degree  to 
simulate  the  system  using  a  given  deadline.   The  decision  supporting  tool  is  added 


to  OOPM  in  order  to  take  these  constraints  into  account  and  determine  the  optimal 
abstraction  degree.  Based  on  the  determined  abstraction  degree,  the  optimal  model 
is  composed.  The  decision  process  is  removed  from  the  modeling  process,  therefore 
modelers  are  relieved  from  considering  time  constraints  that  are  not  supposed  to  be 
part  of  modeling.  The  OOPM/RT  structure  is  shown  in  Figure  1.1. 
Our  method  has  three  phases  : 

1.  Generating  a  set  of  models  at  different  abstraction  levels 

2.  Arranging  a  set  of  models  under  the  abstraction  relationship  and  assessing  the 
quality/cost  for  each  model 

3.  Executing  model  selection  algorithms  to  find  the  optimal  model  for  a  given 
deadline 

In  the  first  phase,  a  set  of  methods  is  generated  at  different  degrees  of  abstraction. 
Many  studies  have  been  performed  on  the  model  abstraction  techniques,  especially  in 
the  modeling  and  simulation  area  [9,  10,  11,  12].  Based  on  the  study  of  model  abstrac- 
tion techniques,  we  propose  a  systematic  abstraction  methodology  to  build  multiple 
methods  of  the  system  at  different  degrees  of  abstraction.  The  second  phase  is  to 
assess  the  expected  quality/runtime  of  each  model  and  to  organize  a  set  of  models  in 
a  way  that  facilitates  the  selection  algorithm  for  real-time  simulation.  In  the  third 
phase,  we  select  an  optimal  model  from  alternatives  by  deciding  the  optimal  abstrac- 
tion level  to  simulate  the  system  within  a  given  time.  A  more  detailed  model  (low  ab- 
straction level)  is  selected  when  we  have  ample  time,  while  a  less  detailed  model  (high 
abstraction  level)  is  used  when  there  is  an  imminent  time  constraint.  Our  method 
does  not  focus  on  proposing  a  new  method  to  measure/predict  model  execution  time 
for  the  second  phase.  Instead,  we  use  an  available  method  and  don't  go  over  the 
model  quality  and  time  assessment  issue  in  detail. 
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Figure  1.1.  OOPM/RT  :  OOPM  is  used  for  the  logical  architecture  design  activity. 
The  Decision  Supporting  Tool  is  integrated  to  handle  physical  architecture  design 
activity.  The  three  components  of  OOPM  (HCI,  Library,  and  Back  End)  are  shown 
outlined  with  dashed  line  boxes.  Parts  within  each  component  are  shown  outlined 
with  solid  boxes:  HCI  (Human  Computer  Interface)  appears  within  Modeler  and 
Scenario;  Back  End  appears  within  Translator  and  Engine;  Library  appear  within 
MMR(OOPM  Model  Repository)  and  MOS(OOPM  Object  Store).  Principal  inter- 
actions are  shown  with  arrows.  A  model  author  interacts  with  both  parts  of  the  HCI. 
The  Decision  Supporting  Tool  interacts  with  OOPM  being  hidden  from  a  model  au- 
thor 


One  of  the  contributions  of  our  research  is  that  with  the  ability  to  select  an 
optimal  model  for  a  given  deadline,  we  provide  a  way  to  handle  real-time  constraints 
for  the  simulation  group.  Another  contribution  is  that  by  generating  a  set  of  multiple 
methods  through  abstraction  techniques  and  selecting  the  optimal  abstraction  degree 
to  compose  a  model  for  the  real-time  simulation,  we  meet  not  only  the  real-time 
constraints,  but  also  gain  the  perspective,  which  allows  modelers  to  see  the  system  for 
a  given  time-constraint  situation.  We  expect  that  the  proposed  method  can  provide 
better  sources  of  multiple  methods  for  real-time  scheduling  groups. 

1.3     Guide  for  the  Reader 

In  Chapter  2,  we  present  a  review  of  prior  work  on  our  problem  statement.  The 
section  begins  with  the  terminology  that  will  be  used  throughout  this  dissertation, 
and  discusses  a  review  of  recent  work  in  Real-time  Scheduling  and  Real-time  Artificial 
Intelligence  (A. I.).  Based  on  the  comparisons  of  the  background  research,  we  discuss 
important  issues  to  be  considered  for  our  problem  statement  and  show  how  we  try  to 
resolve  these  issues  in  OOPM/RT. 

In  Chapter  3,  we  present  our  model  generation  methodology  for  performing  logical 
design  activities  for  real-time  systems.  Two  types  of  abstraction  technique  are  used  to 
the  proposed  model  generation  methodology:  structural  and  behavioral  abstraction. 
Abstraction  process  and  techniques  for  each  type  are  discussed.  The  performance 
results  of  the  abstraction  techniques  are  documented  in  the  Appendix. 

In  Chapter  4,  we  discuss  how  to  perform  physical  design  activities  for  real-time 
simulation.  The  basic  idea  is  to  determine  the  optimal  abstraction  model  for  a  given 
deadline  and  cut  out  less  important  structural  information  to  save  simulation  time. 
We  organize  the  model's  methods  in  a  way  which  facilitates  the  selection  process 
of  the  optimal  abstraction  level.  Two  selection  approaches  are  presented  :  integer 
programming  based  selection  and  search  based  selection.  Analysis  and  experimental 
results  are  presented  with  the  detailed  algorithm  for  each  approach. 
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In  Chapter  5  and  Chapter  6,  we  present  two  examples  to  illustrate  OOPM/RT 
methodology:  FULTON  (a  steamship  modeling)  and  APPLESNAIL  (a  population 
modeling  of  apple  snails).  The  entire  process  from  the  model  generation  phase  to  the 
selection  of  the  optimal  abstraction  model  is  presented. 

In  Chapter  7,  we  review  the  work  presented  in  this  dissertation,  and  then  discuss 
our  perspective  on  the  significance  and  the  contributions  of  this  work.  Finally,  we 
point  to  future  research  directions. 


CHAPTER  2 
BACKGROUND 


Several  areas  of  research  relate  to  our  problem  statement.  (1)  Real-time  schedul- 
ing determines  a  schedule  that  defines  when  to  execute  what  tasks  to  meet  a  given 
deadline  and  the  objective  of  the  system.  Systems  are  modeled  by  a  set  of  tasks.  If 
more  tasks  exist  than  the  system  can  process  for  a  given  time,  the  decision  about 
which  tasks  to  ignore  is  typically  based  on  task  priority  [13,  14].  (2)  Real-time 
Artificial  Intelligence  is  a  field  that  studies  how  to  control  deliberations  in  real 
environments.  Agents  in  real  environments  must  be  able  to  cease  these  deliberations 
when  action  is  demanded,  and  they  must  be  able  to  use  the  available  time  for  deliber- 
ation to  execute  the  most  profitable  computations.  In  this  chapter,  we  review  several 
studies  related  to  our  problem  statement  and  discuss  common  issues  on  modeling 
real-time  systems.  In  Section  2.1,  we  define  some  useful  terms  first,  which  will  be 
used  throughout  this  dissertation.  Several  studies  in  real-time  scheduling  and  real- 
time artificial  intelligence  are  discussed  in  Section  2.2  and  Section  2.3,  respectively. 
Section  2.4  ends  this  chapter  with  brief  explanations  about  how  our  approach  applies 
to  each  of  the  issues  pointed  out  through  the  background  research. 

2.1     Terminology 

A  system  is  a  part  of  some  potential  reality  in  which  we  are  concerned  with 
spacetime  effects  and  causal  relationships  among  parts  of  the  system.  By  identifying 
a  system,  we  are  necessarily  putting  bounds  around  nature  and  the  machines  that  we 
build  [15].  To  model  is  to  abstract  from  reality  a  description  of  a  dynamic  system. 
Modeling  serves  as  a  language  for  describing  systems  at  some  level  of  abstraction  or, 
additionally,  at  multiple  levels  of  abstraction. 
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A  task  is  a  granule  of  computation  treated  by  the  scheduler  as  a  unit  of  work  to 
be  scheduled  or  allocated  processor  time.  A  simulation  model  is  composed  of  static 
and  dynamic  methods  [7],  which  is  a  granule  of  computation  as  a  unit  of  execution. 
Therefore,  a  method  corresponds  to  a  task.  If  a  model  has  only  one  method,  the 
model  corresponds  to  a  task. 

Modeling  about  real-time  systems  should  take  timeliness  requirements  into  ac- 
count. A  strict  definition  of  real-time  is  one  which  the  system  guarantees  that  tasks 
will  receive  up  to  their  worst-case  runtime  and  resource  requirements,  which  presum- 
ably means  that  tasks  will  produce  the  best  possible  results  (highest  quality  results). 
The  less  strict  definition  of  real-time  is  usually  based  on  high-level  goal  achievement, 
rather  than  worst-case  requirements.  One  common  definition  is  that  the  system  will 
statistically  (e.g.,  on  average)  achieve  the  required  quality  value  by  the  required  time, 
but  no  guarantee  is  made  about  any  particular  task  [1,  2].  Throughout  this  disser- 
tation, we  follow  the  less  strict  definition  of  real-time.  If  the  real-time  systems  are 
safety-related  or  otherwise  employ  critical  equipment,  then  every  task  must  be  com- 
pleted before  its  deadline  or  a  disaster  might  occur.  These  systems  are  called  hard 
real-time  systems,  and  are  only  judged  to  be  correct  if  every  task  is  guaranteed  to 
meet  its  deadline.  Other  systems  (such  as  multimedia  systems)  have  deadlines,  but 
are  judged  to  be  in  working  order  as  long  as  they  do  not  miss  too  many  deadlines. 
These  systems  are  called  soft  real-time  systems.  In  a  soft  real-time  systems,  a  task 
is  executed  to  completion  even  if  it  has  missed  its  deadline.  In  this  dissertation,  we 
are  only  interested  in  hard  real-time  systems.  Real-time  simulation  is  an  execution 
of  a  simulation  model  under  hard  real-time  constraints. 

Model  quality  or  accuracy,  especially  in  real-time  systems,  is  the  ability  to 
capture  the  system  at  a  right  level  of  detail  and  to  achieve  the  simulation  objective  for 
a  given  amount  of  time.  Failure  to  produce  a  result  within  the  required  time  interval 
may  cause  severe  damage  to  the  system  or  environment.  Therefore,  timeliness  should 
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be  part  of  the  criteria  to  assess  model  accuracy.  Model  cost  is  defined  by  the  amount 
of  time  which  the  model  needs  to  complete  its  execution. 

We  define  an  optimal  model  as  a  model  that  is  executed  by  the  given  deadline 
and  achieves  the  best  tradeoff  model  accuracy  for  time.  The  optimal  model  has 
the  optimal  abstraction  level  to  simulate  the  system  for  a  given  amount  of  time. 
In  this  sense,  the  optimal  model  selection  process  is  the  procedure  that  finds  the 
optimal  abstraction  level  to  simulate  the  base  model-the  most  detailed  model  of 
the  system-for  a  given  amount  of  time.  Also,  the  optimal  model  selection  process 
corresponds  to  the  process  of  finding  an  optimal  scheduling  strategy  for  given  task 
sets,  as  tasks  correspond  to  models.  Detailed  discussions  on  this  correspondency  is 
found  in  Chapter  4. 

2.2     Real-Time  Scheduling 

Real-time  scheduling  determines  a  schedule  that  defines  when  to  execute  what 
task  to  meet  a  deadline  and  the  objective  of  the  simulation.  Scheduling  is  a  way  of 
modeling  nonfunctional  requirements  imposed  on  real-time  systems. 

For  periodic  task  sets,  the  task  arrival  times,  execution  times,  and  deadlines  are 
very  predictable.  Assume  that  each  task  executes  one  of  n  jobs.  A  request  to  execute 
job  i  occurs  one  every  Tt  seconds.  The  previous  execution  of  the  job  must  be  completed 
before  the  new  job  execution  is  requested.  That  is,  the  start  time  of  the  new  task  is 
the  deadline  of  the  old  task.  Since  only  one  instance  of  a  job  is  executing  at  a  time, 
we  will  label  the  task  executing  job  Ji  as  Tj.  A  description  of  the  task  set  reduces  to 
a  description  of  the  period  and  execution  times  of  the  n  jobs: 

V  =  {Ji  =  (Ci,Ti)|l<i<n} 

A  schedule  is  a  set  A  of  execution  intervals,  described  as: 

A  =  {(si,fi,ti)\i=  1,...} 
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where  s;  is  the  start  time  of  the  interval,  /,  is  the  finish  time  of  the  interval,  and  U  is  the 
task  executed  during  the  interval.  Typical  approaches  to  determine  a  scheduling  set, 
A,  assume  that  task  priorities  and  resource  needs  are  completely  known  in  advance 
and  are  unrelated  to  those  of  other  tasks,  so  that  a  control  component  can  schedule 
tasks  based  on  their  individual  characteristics.  If  more  tasks  exist  than  the  system 
can  process,  the  decision  about  which  tasks  to  ignore  is  simple  and  local,  usually 
based  only  on  task  priority  as  in  the  case  of  rate-monotonic  priority  assignment,  and 
deadline  monotonic  priority  assignment  [13,  14]. 

Research  in  real-time  scheduling  provides  extensive  sources  of  scheduling  method- 
ologies to  handle  timing  constraints.  Schedulability  analysis  methods  [14,  13]  provide 
a  theoretical  solution  to  determine  whether  a  given  set  of  tasks  can  meet  deadlines 
before  actually  exposing  to  real-time  simulations.  Many  applications  are  found  to 
use  schedulability  analysis  methods  as  part  of  the  architecture  in  real-time  applica- 
tions [16].  There  are  two  problems  in  real-time  scheduling  approaches  to  model  and 
simulate  real-time  systems  : 

1.  Difficulty  in  assigning  priorities  to  tasks:  The  resulting  schedule  of  tasks  does 
not  reflect  the  real  objective  of  the  simulation  when  the  selection  is  made  based 
only  on  the  task  priority.  The  typical  priority  scheme  is  to  assign  a  higher  pri- 
ority to  the  task  that  has  an  immediate  deadline.  However,  if  the  high  priority 
task  does  not  contribute  significantly  to  the  overall  objective  of  the  system,  the 
resulting  schedule  cannot  properly  handle  functional  and  nonfunctional  require- 
ments given  to  real-time  systems.  Finding  a  good  priority  scheme  that  meets 
not  only  time  constraints  but  also  simulation  objectives  is  a  difficult  problem. 
Research  on  scheduling  imprecise  computations  studies  how  to  solve  this  prob- 
lem. There  are  two  task  categories  in  imprecise  computations:  mandatory  tasks 
and  optional  tasks.    The  system  schedules  and  executes  tasks  to  complete  all 
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mandatory  tasks  before  their  deadline,  but  may  leave  less  important  tasks  un- 
finished. A  basic  strategy  to  minimize  the  bad  effects  of  timing  faults  is  to 
leave  less  important  tasks  unfinished  if  necessary.  By  trading  off  between  result 
quality  and  computation  time,  imprecise  computing  can  consider  the  overall 
simulation  objective  as  well  as  timing  constraints  [17].  Tasks  should  be  prop- 
erly classified  as  either  a  mandatory  part  or  an  optional  part,  according  to  their 
degree  of  contribution  to  the  simulation  objective,  as  well  as  timing  urgency. 

2.  Lack  of  task  design  methods:    The  main  interest  in  Real-Time  Scheduling  is 

to  provide  an  efficient  scheduling  algorithm  that  handles  timing  constraints 

given  to  each  of  the  tasks,  assuming  that  tasks  are  properly  modeled.  However, 

the  task  modeling  process  itself  should  be  studied  together  with  scheduling 

algorithms  to  complete  the  logical  design  activity  and  physical  design  activity 

as  we  discussed  in  Section  1.  Tasks  should  be  modeled  to  represent  all  functional 

requirements  for  the  given  real-time  system,  so  that  the  scheduling  process  can 

focus  on  handling  nonfunctional  requirements. 

2.3     Real-Time  Artificial  Intelligence 

As  AI  systems  move  into  more  complex  domains,  all  problems  become  real-time 
because  the  agent  will  never  have  enough  time  to  solve  the  decision  problem  ex- 
actly. D'Ambrosio  described  the  real-time  AI  as  a  type  of  problem-solving  method: 
"given  a  time  bound,  dynamically  construct  and  execute  a  problem  solving  proce- 
dure which  will  (probably)  produce  a  reasonable  answer  within  (approximately)  the 
time  available"  [18].  Most  AI  systems  use  some  form  of  approximation  to  reduce  the 
nondeterminism  and  make  system  performance  more  predictable  for  use  in  real-time 
situation. 

At  least  two  broadly  different  kinds  of  approximation  algorithms  have  been  used 
in  real-time  AI  research  [1,  2]  to  handle  functional  and  nonfunctional  requirements 
inherent  to  real-time  systems.  They  are  : 
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1.  Iterative  refinement-  where  an  imprecise  answer  is  generated  quickly  and  refined 
through  a  number  of  iterations. 

2.  Multiple  methods  -  where  a  number  of  different  algorithms  are  available  for 
a  task,  each  of  which  is  capable  of  generating  solutions.  These  algorithms 
emphasize  different  characteristics  of  the  problem  which  might  be  applicable 
in  different  situations.  These  algorithms  also  make  tradeoffs  of  solution  versus 
time. 

In  this  section,  we  examine  each  of  two  approximation  algorithms  in  some  detail. 
2.3.1     Iterative  Refinement 

Anytime  algorithm  is  an  algorithm  whose  output  quality  improves  gradually  over 
time,  so  that  it  has  a  reasonable  decision  ready  whenever  it  is  interrupted.  It  is  ex- 
pected that  the  quality  of  the  answer  will  increase  as  the  anytime  algorithm  is  given 
increasing  runtime  up  to  some  maximum  quality.  Associated  with  each  anytime  al- 
gorithm is  a  performance  profile,  which  is  a  function  that  maps  from  the  time  given 
to  an  anytime  algorithm  and  the  value  produced  by  that  algorithm.  Table  2.1  is  a 
simple  anytime  algorithm  for  solving  the  Traveling  Salesman  Problem  (TSP).  This 
algorithm  quickly  constructs  an  initial  tour,  registers  that  result  (making  it  available 
when  the  algorithm  should  be  halted),  then  repreatedly  chooses  two  random  edges 
and  evaluates  whether  switching  them  results  in  a  better  tour;  if  it  does,  the  algo- 
rithm updates  the  registered  solution  to  that  new  tour.  Anytime  algorithms  have 
the  advantage  of  always  having  an  answer  at  hand,  so  they  can  respond  quickly  to 
changing  environmental  situations.  They  also  provide  maximum  flexibility  to  control 
mechanisms  by  allowing  any  incremental  amount  of  extra  work  to  result  in  an  incre- 
mentally improved  result.  These  features  make  anytime  algorithms  particularly  useful 
in  many  real-time  applications.  Examples  are  found  in  real-time  decision  making  and 
diagnosis  systems  [19,  20]. 
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Tour  <-  INITIAL-TOUR(  V) 

cost*-  COST  (Tour) 

REGISTER-RESULT(  Tour) 

for    •<—  1  to  iter 

d  <-  RANDOM-EDGE(  Tour) 

e2  <-  RANDOM-EDGE  [Tour) 

5  <-  COST(Tour)  -  COST(SWITCH( Tour,  eu  e2)) 

if  5  >  0  then 

Tour  <r-  SWITCH(  Tour,  ex,  e2) 

cost  <—  cost  -  5 

REGISTER-RESULT(  Tour) 
SIGNAL(TERMINATION) 
HALT 


Real-time  search  techniques  are  another  example  of  the  iterative  refinement  ap- 
proach to  handling  physical  requirements  given  to  real-time  systems.  Examples  of 
this  type  are  found  in  modern  chess  programs  [21,  22].  Virtually  all  performance 
chess  programs  in  existence  today  use  full-width,  fixed-depth,  alpha-beta  minimax 
search  with  node  ordering,  quiescence,  and  iterative-deepening  for  real  time  problem 
solving.  They  make  very  high  quality  move  decisions  under  real-time  constraints 
by  properly  controlling  the  depth  of  search  (or  move)  and  having  a  good  heuristic 
function  that  guides  the  search  (or  move).  RTA*  [22]  is  an  example  of  a  real-time 
search  algorithm  that  effectively  solves  normal  state-space  search  problems  based  on 
A*  algorithm.  The  basic  idea  is  to  interleave  moving  down  what  appears  to  be  the 
best  path  so  far  with  refining  the  idea  of  what  the  best  path  is.  The  refining  of  the 
best  path  is  done  using  a  simple  search  algorithm  that  searches  to  a  fixed  depth.  The 
fixed  depth  is  chosen  depending  on  the  amount  of  time  allowed  for  each  move,  which 
is  determined  using  a  heuristic  estimate  of  the  number  of  moves  required  to  get  to  a 
goal  state  and  the  total  amount  of  time  allowed.  The  result  is  that  the  total  search 
time  and  the  search  time  per  move  are  tightly  controlled.  The  quality  of  the  result 
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depends  significantly  on  the  accuracy  of  the  heuristics  used  to  estimate  the  distance 
from  a  goal  state  and  the  ability  of  limited  depth  search  to  recommend  moves  in  the 
direction  of  a  goal  state. 

The  key  to  these  approaches  is  to  represent  the  knowledge  about  the  modeled 
system  in  a  problem  solving  method  and  make  the  single  problem  solving  method  that 
achieves  a  better  result  as  more  time  is  given.  Information  about  the  objectives  (goals) 
of  real-time  simulation  is  encoded  into  search  heuristics,  and  the  optimal  schedule  for 
a  given  time  constraint  is  searched  based  on  the  heuristics.  Therefore,  unlike  the 
real-time  scheduling  approach,  the  resulting  schedule  from  the  iterative  refinement 
approaches  provides  a  good  framework  for  representing  not  only  timing  constraints, 
but  also  the  overall  simulation  objectives  of  the  system.  Our  claims  for  iterative 
refinement  approaches  are  : 

1.  Iterative-refinement  approaches  rely  on  the  existence  of  algorithms  that  pro- 
duce incrementally  improving  solutions  as  they  are  given  increasing  amounts  of 
runtime.  Clearly,  such  algorithms  work  well  in  some  problem  cases,  but  also 
there  are  problems  that  will  be  difficult  to  solve  in  an  incremental  fashion  [1,  2]. 

2.  Iterative-refinement  based  approaches  are  made  on  the  assumption  that  one 
anytime  algorithm  (iterative  refinement  algorithm)  is  available  that  is  expected 
to  work  effectively  in  all  environmental  situations.  However,  when  we  model 
complex  systems,  it  is  very  difficult  to  develop  a  comprehensive  multipurpose 
anytime  algorithm  to  cover  all  possible  environmental  situations.  This  task  is 
much  more  complicated  when  some  situations  conflict  with  others  [23,  24,  1,2]. 

2.3.2     Multiple  Methods 

An  alternative  to  iterative-refinement  approach  is  to  have  multiple  methods  to 
model  the  system  that  make  tradeoffs  in  cost  versus  quality,  and  which  may  have 
different  performance  characteristics  in  different  environment  situations.  The  multiple 
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method  approach  has  at  least  two  potential  advantages  over  an  anytime  algorithm 
approach: 

1.  The  multiple  methods  based  approach  does  not  rely  on  the  existence  of  iterative 
refinement  algorithms. 

2.  Multiple  methods  do  not  just  make  quality/duration  tradeoffs;  they  can  be 
entirely  different  approaches  to  solving  the  problem.  These  approaches  can  have 
very  different  characteristics  depending  on  particular  environmental  situations. 
That  is,  the  quality/duration  tradeoffs  made  by  multiple  methods  can  be  very 
different  in  different  environmental  situations. 

Garvey  and  Lesser  proposed  the  Design-to- Time  [2,  25]  method.  Design-to-time 
assumes  that  we  have  multiple  methods  for  the  given  tasks.  After  generaing  multiple 
methods  for  the  given  tasks,  Design-to -Time  finds  a  solution  to  a  problem  that  uses 
all  available  resources  to  maximize  solution  quality  within  the  available  time.  For 
the  sources  of  multiple  methods,  Design-to-time  uses  approximate  processing.  Ap- 
proximate processing  is  an  approach  to  real-time  problem  solving  in  situations  where 
sacrificing  answers  are  acceptable  and  some  combination  of  data,  knowledge,  and  con- 
trol approximations  are  available.  Several  approximation  techniques  are  studied  in 
complex  signal  interpretation  tasks.  Three  approximation  methods  are  proposed:  1) 
approximate  algorithms,  2)  data  approximations,  and  3)  knowledge  approximations. 
The  usefulness  of  these  approximations  is  found  in  the  Distributed  Vehicle  Monitor- 
ing Testbed  (DVMT).  An  example  of  approximate  knowledge  from  the  DVMT  is  an 
approximation  that  can  replace  the  multiple  steps  involved  in  interpreting  low  level 
sensor  data.  If  a  vehicle  level  knowledge  involves  group  level  and  signal  level  data, 
the  knowledge  approximation  is  performed  by  skipping  the  intermediate  level,  which 
is  the  group  level.  Data  approximation  can  appear  in  the  DVMT  in  the  form  of  time 
skipping  and  clustering.  In  time  skipping,  some  cycles  are  skipped,  instead  of  using 
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data  from  every  sensor  interpretation  cycle.  Algorithm  approximation  is  related  to 
the  use  of  algorithms  where  the  form  of  solutions  to  at  least  some  intermediate  prob- 
lems is  shared.  This  allows  some  intermediate  problem  solving  steps  to  be  skipped 
or  rearranged  to  save  time.  After  generating  multiple  methods  based  on  approxi- 
mation techniques,  this  work  uses  a  model  of  computational  tasks  known  as  TEMS. 
TEMS  models  the  problems  as  consisting  of  independent  task  groups  that  contain 
possibly  dependent  tasks.  The  task/subtask  relationship  among  tasks  and  within  a 
task  group  forms  a  directed  acyclic  graph  and  is  used  to  calculate  the  quality  of  a 
task  (i.e,  the  quality  of  a  task  is  a  function  of  the  qualities  of  its  subtasks).  Leaf  nodes 
of  this  graph  are  executable  methods  which  represent  actual  computations  that  can 
be  performed  by  the  system.  Besides  task/subtask  relationships,  tasks  may  also  have 
other  interdependencies  with  other  tasks  in  their  task  group  (e.g.,  the  execution  of 
one  method  enabling  the  execution  of  another,  or  the  use  of  a  rough  approximation 
by  one  method  negatively  affecting  (hindering)  the  performance  of  a  method  that 
uses  its  result).  These  interdependencies  can  have  a  quantitative  effect  on  the  quality 
and  duration  of  affected  methods.  The  methodology  is  known  as  design-to-time  be- 
cause it  advocates  the  use  of  all  available  time  to  generate  the  best  solutions  possible. 
Schedulings  algorithms  are  performed  based  upon  the  TEIMS  structure.  Briefly,  the 
algorithm  recursively  finds  all  methods  for  executing  each  task  in  the  task  structure, 
pruning  those  methods  that  are  superseded  by  other  methods  that  generate  greater 
or  equal  quality  in  equal  or  less  time.  In  the  worst  case,  this  algorithm  shows  0(m\) 
where  m  is  the  number  of  executable  methods.  If  all  methods  are  strictly  ordered  by 
precedence  constraints,  then  the  complexity  is  reduced  to  2m. 

The  multiple  methods  approach  has  a  clear  framework  to  model/simulate  real-time 
systems: 
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1.  Approximation  deals  with  functional  requirements  given  to  the  real-time  system. 

2.  Scheduling  algorithm  handles  nonfunctional  requirements  to  simulate  the  mul- 
tiple methods. 

3.  A  model  of  computational  tasks,  such  as  TtEM,  bridges  logical  design  activity 
and  physical  design  activity  by  organizing  multiple  methods  in  a  way  to  facilitate 
the  scheduling  process. 

Though  Design-to-time  models  functional  aspects  of  real-time  systems  using  dif- 
ferent types  of  approximations,  the  multiple  methods  for  a  system  only  differs  in 
the  degree  of  behavioral  detail;  therefore,  the  resulting  multiple  methods  may  not 
provide  useful  information  about  viewing/analyzing  the  system  in  both  its  structural 
and  behavioral  aspects.  A  different  sampling  rate  cannot  abstract  away  unnecessary 
structural  details  to  view  the  system  under  a  given  amount  of  time.  Also,  skipping 
the  intermediate  levels  cannot  cut  out  the  actual  base  methods,  since  an  intermediate 
level  is  just  a  collection  of  the  executable  methods.  Sharing  intermediate  information 
between  methods  does  not  cut  out  the  shared  structural  information  between  multiple 
methods.  All  these  observations  suggest  that  the  selected  methods  may  not  provide 
an  optimal  abstract  model,  in  which  a  system  should  be  viewed  under  a  time  critical 
situation,  both  in  terms  of  its  structural  and  behavioral  aspect. 

2.4     Summary 

Background  research  for  the  problem  statement  pointed  to  several  issues,  which 
are  basically  summarized  with  two  fundamental  questions: 

•  How  to  generate  tasks  that  capture  functional  requirements  given  to  real-time 
systems 

•  How  to  simulate  the  tasks  to  meet  a  deadline  while  satisfying  the  simulation 
objective 
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Real-time  scheduling  group  provides  an  extensive  set  of  scheduling  methodologies 
based  on  a  priority  scheme.  However,  the  generation  of  task  sets  for  a  given  system 
has  not  been  well-addressed  in  the  group.  Also,  the  selection  of  tasks  to  determine 
the  schedule  does  not  consider  the  overall  objective  of  the  system.  Anytime  algorithm 
group  finds  optimal  scheduling  through  an  iterative  refinement  technique.  Through 
the  advantage  of  producing  results  in  any  time,  anytime  algorithms  have  been  used 
to  construct  large  scale  real  world  applications.  However,  finding  the  multipurpose 
iterative  algorithm  for  all  environmental  situations  is  a  difficult  job,  especially  when 
some  situations  may  conflict  with  others.  The  multiple  methods  approach  found  in 
Design-to- Time  can  be  used  where  sacrificing  solution  quality  can  be  tolerated  so  that 
the  domains  can  be  modeled  by  multiple  solutions  methods  (which  make  trade-offs  in 
solution  quality  and  execution  time) .  Separating  the  generation  process  of  multiple 
methods  from  the  determination  of  the  optimal  scheduling  process  provides  a  flexible 
structure  to  separately  perform  logical  design  activity  and  physical  design  activity. 
However,  the  generated  multiple  methods  only  differ  in  their  degree  of  behavioral 
detail,  and  may  not  provide  a  perspective  to  view  the  structure  of  the  system  for 
a  given  amount  of  time.  Based  on  the  issues  learned  from  background  research,  we 
believe  the  following  requirements  are  useful  in  order  to  provide  an  efficient  modeling 
framework  for  real-time  systems  : 

1.  An  efficient  modeling  methodology  to  generate  multiple  methods  of  the  real- 
time system 

2.  Separation  of  the  scheduling  process  from  the  modeling  process 

3.  Decision  of  the  optimal  scheduling  based  on  the  simulation  objective 

Our  approach  for  the  generation  of  multiple  methods  is  to  use  an  efficient  model 
abstraction  technique.  The  model  abstraction  technique  should  consider  how  to  cap- 
ture the  modeled  system,  both  in  structural  and  behavioral  terms,  in  order  to  meet 
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the  simulation  objective.  We  use  OOPM  for  this  purpose.  Multimodeling  is  the  model 
abstraction  methodology  that  OOPM  follows.  In  the  multimodeling  methodology,  we 
start  from  a  simple  model  type,  and  refine  it  as  the  model  author  needs  more  fidelity. 
Refinement  of  a  model  can  be  done  with  the  same  model  type  or  different  model 
types.  Multimodeling  provides  a  way  to  combine  heterogeneous  model  types  under 
one  structure.  This  allows  modelers  to  use  different  model  types  to  describe  the  sys- 
tem according  to  the  characteristics  of  the  component  being  modeled  in  a  way  that 
reflects  the  objective  of  the  modeling  and  simulation.  The  selection  of  the  optimal 
scheduling  is  done  based  on  the  multimodeled  components.  The  selection  process  is 
separated  from  the  model  generation  process;  in  this  way,  modelers  are  placed  out  of 
the  selection  process.  The  scheduling  process  decides  an  optimal  abstraction  level  of 
the  constructed  model.  Less  important  structural  information  is  abstracted  away  to 
save  simulation  time.  The  best  tradeoffs  of  model  accuracy  versus  time  are  achieved 
through  the  selection  process.  Therefore,  the  selected  model  can  be  a  useful  device 
that  reflects  the  right  perspective  to  view  the  system  for  a  given  amount  of  time; 
additionally,  it  achieves  the  best  tradeoffs  in  model  execution  time  versus  accuracy. 

In  Chapter  3,  we  discuss  a  methodology  for  generating  tasks  as  our  way  of  logical 
design  activity.  Chapter  4  corresponds  to  physical  design  activity.  We  present  the 
selection  method  for  the  optimal  model  and  discuss  how  we  solve  the  issues  pointed 
out  through  this  chapter. 


CHAPTER  3 
MODEL  GENERATION  METHODOLOGY 


This  chapter  discusses  how  we  generate  a  set  of  models  to  capture  functional 
requirements  inherent  to  real-time  systems.  Real  world  dynamic  systems  involve  a 
large  number  of  variables  and  interconnections.  Unnecessary  details  about  the  system 
are  often  omitted  in  order  to  represent  the  system  on  digital  computers.  Abstraction 
is  a  technique  of  suppressing  details  and  dealing  instead  with  the  generalized,  idealized 
model  of  a  system.  Computational  efficiency  and  representational  economy  are  main 
reasons  for  using  abstract  models  in  simulation  [26,  27,  28],  as  well  as  in  programming 
languages  [29,  30,  31].  Our  model  generation  methodology  uses  abstraction  techniques 
to  efficiently  represent  complex  systems. 

Our  model  abstraction  methodology  has  two  types  of  abstraction:  1)  structural  ab- 
straction, and  2)  behavioral  abstraction.  Structural  abstraction  is  a  process  of  organiz- 
ing the  system  hierarchically,  while  behavioral  abstraction  focuses  only  on  behavioral 
equivalence  without  structural  preservation.  We  explore  both  of  these  abstraction 
types  together  when  constructing  systems.  Structural  abstraction  is  an  iterative  pro- 
cedure in  which  a  model  is  designed  with  simple  model  types  first,  and  refined  with 
more  complex  model  types  later  until  the  desired  fidelity  is  achieved.  Behavioral 
abstraction  is  applied  on  the  abstraction  hierarchy  that  has  been  constructed  from 
the  structural  abstraction  process.  When  we  want  to  isolate  an  abstraction  level, 
we  apply  the  behavioral  abstraction  method  at  that  level,  and  generate  a  black-box 
that  approximates  the  behaviors  of  the  rest  of  the  hierarchy.  By  combining  structural 
and  behavioral  abstraction,  each  level  of  abstraction  becomes  independent  from  the 
lower  abstraction  levels.    Therefore,  a  level  can  be  executed  apart  from  the  rest  of 
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Table  3.1.  Model  generation  methodology  :  we  generate  a  set  of  models  based  on 
abstraction  methodology.  Two  types  of  abstraction  are  employed:  structural  and 
behavioral  abstraction.  Behavioral  abstraction  is  performed  based  on  the  abstraction 
hierarchy  constructed  from  the  structural  abstraction 


Model  Generation  Methodology 


Perform  structural  abstraction  using  Multimodeling  methodology; 
£  =  0; 

While  (  there  is  a  need  to  save  simulation  execution  time)  do 
begin 
For  the  entire  multimodeling  structure 
Check  if  a  model  component,  ftA,  is  within  user  interest; 
If  M  is  irrelevant  to  user  interest 
B  =  BUM; 
end 

Apply  behavioral  abstraction  to  A  €  B 
end 


the  hierarchy,  unlike  traditional  hierarchical  modeling  methodologies  [32,  15].    The 
overall  procedure  is  shown  in  Table  3.1. 

In  Section  3.1,  we  first  discuss  the  structural  abstraction  process.  The  process  of 
behavioral  abstraction  follows  in  Section  3.2. 

3.1     Structural  Abstraction 

Models  that  are  composed  of  other  models  in  a  network  or  graph  are  called  mul- 
timodels.  Most  real-world  models  are  multimodels,  since  normal  models  are  good  at 
portraying  only  a  subset  of  the  overall  device  or  system  behavior  [27,  15].  Structural 
abstraction  is  a  process  of  generating  multimodels  using  refinement  and  homomor- 
phism.  Refinement  is  the  process  of  refining  a  model  to  more  detailed  models  of  the 
same  type  (homogeneous  refinement)  or  different  types  (heterogeneous  refinement); 
homomorphism  is  a  mapping  that  preserves  the  behavior  of  the  lower-level  system 
under  the  set  mappings  [15].  In  homogeneous-structural  abstraction,  dynamical  sys- 
tems are  abstracted  with  only  one  model  type.  Each  model  component  is  modeled 
with  one  model  type  and  refined  with  the  same  model  type.    Selection  of  specific 
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Structural  Abstraction 


Refinement 


Homomorphism 


Homogeneous  Heterogeneous    Homogeneous  Heterogeneous 


Figure  3.1.  Taxonomy  of  structural  abstraction  methods 

model  type  is  important  in  homogeneous  structural  abstraction,  and  depends  on  the 
information  that  one  expects  to  receive  from  analysis.  For  example,  one  would  not 
choose  to  model  low-level  physical  behavior  with  a  Petri  net,  since  a  Petri  net  is  an 
appropriate  model  type  for  a  particular  sort  of  condition  within  a  system,  where  there 
is  a  contention  for  resources  by  discretely-defined  moving  entities.  In  heterogeneous- 
structural  abstraction,  a  system  is  abstracted  with  different  model  types  by  allowing 
either  homogeneous  or  heterogeneous  model  types  together  under  one  structure.  Fig- 
ure 3.1  summarizes  our  taxonomy  on  the  structural  abstraction. 

We  use  multimodeling  methodology  for  the  structural  abstraction  phase.  Multi- 
modeling  is  a  methodology  [33,  34,  35,  36,  37]  that  provides  a  way  of  structuring  a 
heterogeneous  and  homogeneous  set  of  model  types  together  so  that  each  type  per- 
forms its  part,  and  the  behavior  is  preserved  as  levels  are  mapped  [38,  28,  39].  By 
using  multimodeling  as  a  method  for  the  structural  abstraction,  we  cover  all  categories 
of  the  taxonomy  in  Figure  3.1. 

Modelers  start  the  multimodeling  process  by  applying  simple  types  first  and  then 
refining  them  as  more  fidelity  is  needed.  Therefore,  two  activities  are  performed  in 
structural  abstraction  process:  1)  selection  of  the  model  type,  and  2)  refinement. 


•  Selection  of  the  model  type 

The  decision  about  the  proper  model  type  is  made  by  the  following  heuristics 
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1.  If  the  system  has  discrete  states  or  events,  specify  them  using  a  declara- 
tive model. 

2.  If  there  are  phases  of  a  process,  use  a  declarative  model  to  model  phase 
transitions.  Phase  transitions  can  be  temporal  or  spatial  if  the  spatial 
regions  are  irregular. 

3.  If  the  problem  is  given  in  terms  of  distinct  physical  objects  which  are 
connected  in  a  directed  order,  use  a  functional  model. 

4.  If  the  problem  involves  a  material  flow  throughout  the  system,  use  a  func- 
tional model. 

5.  If  the  problem  can  be  viewed  with  balance  (e.g.,  laws  of  nature)  and  in- 
variance,  use  a  constraint  model. 

6.  If  the  problem  involves  a  set  of  premises  and  consequences,  use  a  rule-base 
model. 

Examples  of  each  model  type  are  summarized  in  Table  3.2.  Once  the  model  type 
is  determined,  the  model  is  refined  by  homogeneous  or  heterogeneous  models  based 
on  the  model  type. 

•  Refinement  : 

Refinements  are  performed  to 

1.  state,  event,  and  transition  in  declarative  modeling 

2.  blocks  in  FBM  and  level,  auxiliary,  rate,  source,  constant,  flow  arc, 
cause-and-effect  arc,  and  sink  in  SD  [15]. 

3.  coefficients  and  non-state  variables  in  constraint  modeling 

4.  premises  and  consequences  in  rule-based  modeling 

Refinement  step  iteratively  occurs  until  the  desired  fidelity  is  achieved.  Multimod- 
eling  methodology  provides  a  mechanism  that  each  model  component  is  connected 
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S2 


B3 


Figure  3.2.  Structural  abstraction  :  Multimodeling  tree  structure  for  model  refine- 
ment. Selective  refinements  achieve  required  fidelity.  Extensibility  facilitates  model 
development.  The  polygons  in  the  Figure  depict  the  heterogeneous  nature  of  multi- 
modeling:  each  type  of  polygon  represents  one  type  of  dynamic  model.  Bi  represents 
FBM,  Fi  represents  FSM,  Si  represents  SD,  Ei  represents  EQN,  and  Ri  represents 
RBM 


through  the  refinement  relationship.  A  model  constructed  from  the  structural  ab- 
straction process  becomes  the  base  model  of  the  system.  The  base  model  simulates 
the  system  at  the  highest  detail.  Figure  3.2  shows  an  example  of  the  abstraction 
hierarchy  that  is  constructed  from  structural  abstraction  process.  Blocks  in  FBM 
model  Bi  are  refined  into  different  model  types,  S2  (SD),  E2  (EQN),  and  F2  (FSA). 
States  and  premises  in  F2  are  further  refined  into  different  model  types. 

By  modeling  a  system  with  different  model  types  together,  we  provide  a  way  to 
capture  the  system  with  different  perspectives.  The  selection  of  the  model  type  is 
made  based  on  the  characteristic  of  each  component  being  modeled;  different  kinds 
of  information,  for  instance,  state  transition  information  along  with  functional  direc- 
tionality information,  are  organized  hierarchically  to  form  a  base  model.  Selective 
refinement  provides  a  way  to  represent  simulation  objective.  If  a  system  component 
has  great  importance  for  the  simulation  objective,  refinment  steps  are  iteratively  ap- 
plied to  it  until  the  desired  fidelity  is  achieved. 
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Table  3.2.  Structural  abstraction  techniques 


Model  type 

Techniques 

Declarative  Modeling 

Finite  State  Machine  (FSM) 
Finite  Event  Machine  (FEM) 

Functional  Modeling 

Functional  Block  Model  (FBM) 
System  Dynamics  (SD) 

Constraint  Modeling 

Algebraic  equations 

Ordinary/Partial  Differential  Equations 

Rule-Based  Modeling 

Knowledge-Based  Simulation  (KBS) 

While  the  multimodel  approach  is  sound  for  well-structured  models  defined  in 
terms  of  state  space  functions  and  set-theoretic  components,  selecting  system  com- 
ponents in  each  level  are  dependent  on  the  next-lowest  level,  due  to  the  hierarchical 
structure.  For  example,  in  Figure  3.2,  suppose  a  modeler  wants  to  look  at  the  model 
at  level,  F2.  The  information  under  F2  should  be  omitted  to  simulate  the  model. 
However  the  execution  needs  to  know  R3,  F3,  and  53,  since  they  are  where  the  part 
of  the  execution  information  of  F2  is  located.  This  implies  that  we  are  unable  to  run 
each  level  independently.  It  is  possible  to  obtain  output  for  any  abstraction  level  but, 
nevertheless,  the  system  model  must  be  executed  at  the  lowest  levels  of  the  hierarchy, 
since  there  is  where  we  find  the  actual  functional  semantics  associated  with  the  model. 
A  new  definition  and  methodology  is  needed  to  better  handle  abstraction  of  systems 
and  components.  This  is  where  the  behavioral  abstraction  approaches  are  employed. 
By  incorporating  behavioral  abstraction  approaches  into  multimodeling  methodology, 
the  multimodeling  methodology  allows  each  level  to  be  understood  and  executed  in- 
dependently of  the  others.  In  this  way,  discarding  all  the  abstractions  below  any  given 
level  will  still  result  in  a  complete  behavioral  description  of  a  system  [9,  10,  11,  40]. 

3.2     Behavioral  Abstraction 


Behavioral  abstraction  is  where  a  system  is  abstracted  by  its  behavior.  We  replace 
a  system  component  with  a  generic  black-box  that  approximates  the  behavior  of  the 
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system  without  structural  preservation.  Behavior  is  defined  as  a  set  of  input-output 
data  pairs. 

We  have  two  approaches  of  specifying  system  behavior: 

•  Static  approach  :  we  take  a  system  and  capture  only  the  steady  state  output 
value  instead  of  a  complete  output  trajectory.  The  input  value  is  defined  to  be 
the  integral  of  time  value  over  the  simulation  trajectory. 

•  Dynamic  approach  :  we  need  to  associate  time-dependent  input  and  output 
trajectories. 

Though  static  and  dynamic  approaches  describe  different  allowable  behaviors  of 
the  same  phenomenon,  abstraction  techniques  for  dynamic  approach  can  be  also  ap- 
plied to  static  approach.  Therefore,  we'll  focus  on  dynamic  behavioral  abstraction  to 
illustrate  behavioral  abstraction  process  and  techniques. 
3.2.1     Behavioral  Abstraction  Process 

The  process  of  our  behavioral  abstraction  is  equivalent  to  meta  modeling  process 
as  shown  in  Figure  3.3.  As  the  real-world  systems  are  represented  on  a  computer 
throughout  the  modeling  process,  a  model  of  the  simulation  model  is  constructed 
through  the  meta  modeling  process.  In  general,  metamodels  are  used  either  to  perform 
sensitivity  analysis,  to  optimize  a  system,  to  identify  important  factors,  or  to  gain 
understanding  about  the  relation  between  the  inputs  and  outputs  of  a  system  [41,  42]. 
Our  objective  is  to  use  metamodels  to  speed  up  simulations  by  making  each  level  of 
the  abstraction  hierarchy  able  to  be  executed  independently. 

The  behavioral  abstraction  process  takes  three  steps  : 

•  Step  1.  Obtain  Data 

We  denote  the  output  of  a  simulation  model  at  time  t  by  y(t)  and  the  input 
by  u(t).    The  data,  defining  system  behavior,  are  assumed  to  be  collected  in 
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Figure  3.3.  Behavioral  abstraction  process  :  Behavioral  abstraction  process  corre- 
sponds meta  modeling  process,  in  the  sense  that  behavioral  abstraction  model  is  a 
model  of  the  simulation  model 

discrete  time.  At  time  t  —  1  we  have  the  data  set 


Z1-1  =y(l),u(l),...,y(t-l),u(t-l) 


(3.1) 


Step  2.  Fit  the  metamodel 

A  meta  model  of  a  dynamical  system  can  be  seen  as  a  mapping  from  past  data 
Zl~x  to  the  next  output  y(t): 


y(t)  =  g(Z^) 


(3.2) 


A  "hat"  on  y  is  to  emphasize  that  the  assigned  value  is  a  prediction  rather  than 
a  measured,  "correct"  value  for  y(t).  The  problem  of  dynamic  behavioral  ab- 
straction is  to  find  a  mapping  g  that  gives  good  prediction  in  equation  3.2  using 
the  information  in  a  data  record  Zt_1,  as  in  the  case  of  meta  modeling.  Accord- 
ing to  the  methodology  to  produce  g,  different  types  of  behavioral  abstraction 
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model  can  be  generated;  1)  Analytical  meta  models,  2)  Rule-Based  meta 
models,  and  3)  Neural  Network  Based  meta  models.  Table  3.3  summarize 
respective  advantages  of  each  metamodeling  technique.  Based  on  Table  3.3,  a 
proper  type  of  behavioral  abstraction  technique  is  selected  for  a  system  compo- 
nent being  examined. 

•  Step  3.  Assess  the  validity  of  the  model 

Behavioral  abstraction  model,  g,  is  valid,  when  the  behavior  from  g  approxi- 
mates that  of  the  corresponding  structural  model,  5,  in  some  sense,  to  within 
a  desired  degree  of  precision.  In  other  words,  given 

1.  a  structural  model  S 

2.  a  class  of  input  {  u(t)  }  =  U 

3.  a  behavioral  model  g 

4.  a  criterion  function  Fc(g,S)  which  is  a  measure  of  the  goodness  of  fit 
between  Vg(t)  and  ys(t),  where  y  is  an  output  vector 

5.  an  error  criterion  e 

Then,  g  is  valid  if 

Fc(g,S)<e  (3.3) 

A  possible  choice  for  Fc  is  SSE  (Sum  of  Squared  Error)  between  the  output  y-g 
and  ys,  i.e., 

Fc(g,S)  =  J2(y^t)-ys(t))2<e  (3.4) 

Or  a  suitable  norm,  i.e., 

Fc(g,S)=\\y§(t)-ys(t)\\<e  (3.5) 

In  the  next  section,  we  illustrate  available  techniques  to  generate  g. 
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Table  3.3.  Advantages  of  behavioral  abstraction  models 


Model 

Advantages 

Analytic  Models 

-  Only  very  little  memory  is  used,  not  time-consuming 

-  A  clear  understanding  of  and  insight  into  the  effects 

of  factors  and  response 

-  Independent  structure 

Rule-Based  Models 

-  Easily  understandable 

-  Represent  modular  knowledge 

-  Modularity  of  rules  facilitates  future  updating 

-  Self-explanation  about  the  effects  of  factors  and  response 

Neural  Network 
Based  Models 

-  Address  nonlinearity 

-  Reduce  time  and  memory 

-  Updating  weights  can  integrate  certain  future  changes  of 
the  system 

3.2.2     Behavioral  Abstraction  Techniques 

We  have  studied  three  techniques  for  behavioral  abstraction  process:  1)  System 
Identification,  2)  Neural  Network,  and  3)  Wavelets.  In  this  section,  we  discuss 
each  technique  in  detail. 

System  Identification 

System  identification  [43,  44]  is  the  theory  and  art  of  building  mathematical  (an- 
alytical) model  of  gt. 

For  a  dynamic  system  with  the  input  at  time  t  denoted  by  ip(t)  and  the  output 
at  time  t  denoted  by  y(t)  the  data  will  be  a  finite  collection  of  observations: 


Z»  =  {[y(t),  <p(t);t=l,...,N]} 


(3.6) 


System  identification  infers  some  patterns  from  the  "training  set"  in  equation  3.6 
and  guesses  about  y(N  +  l)  based  on  (p(N  +  l).  The  mathematical  modeling  approach 
is  to  construct  a  function  gk(t,(p{t))  based  on  the  training  set  ZN,  and  to  use  this 
function  for  pairing  y(t)  to  new  </?(£): 
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y(t)  =  9N{t,<p{t))  (3.7) 

The  function  g~N  is  thus  the  mathematical  model  of  how  ip(t)  and  y(t)  relate.  The 
observed  pattern  in  equation  3.6  has  been  condensed  into  the  mapping  equation  3.7. 

Two  model  types  are  available  for  g^:  1)  parametric  model,  and  2)  nonparametric 
model.  Parameter  models  are  described  (parameterized)  in  terms  of  a  finite  number 
of  parameters.  These  parameters  are  denoted  by  0.  The  family  of  candidate  model 
functions  are  called  a  model  structure,  and  we  write  the  functions  as 

g(t,0Mt))  (3-8) 

The  value  y(t)  is  thus  matched  against  the  "candidate"  g(t,0,(p(t)): 

y(t)  g(t,9,<p(t))  (3.9) 

The  search  for  a  good  model  function  is  then  carried  out  in  terms  of  the  parameters 
6,  and  the  chosen  value  On  gives  us 

gk(t,<p(t))=g(t,0"N,ip(t))  (3.10) 

Commonly  used  parameter  models  are  ARX  (Auto  Regressive),  ARM  AX  (Auto  Re- 
gressive Moving  Average),  OE  (Output  Error)  and  BJ  (Box- Jenkins)  [43,  45,  46].  For 
example,  a  first  order  ARMA  model  of  {y(t)} 

y(t)  +  ay(t-l)  =  u(t)  +  ue(t  -  1)  (3.11) 

is  obtained  for 
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9  =     (a,c) 

<p(t)  =    (y(0),y(l),...,y(t-l))  (3  u) 

9(t,9Mt))   =   Z£}0(c-i)(-c)t-k-1y(k) 

Other  parametric  model  examples  are  found  in  the  Appendix  with  performance  results 
in  actual  applications. 

If  a  system  is  assumed  to  belong  to  a  very  broad  class  of  systems  that  cannot  be 
parameterized  by  a  finite  number  of  parameters,  we  model  it  with  non-parametric 
model  structure.  Non-parametric  model  can  be  thought  of  as  the  limit  of  increasing 
model  structures  [44],  which  are  parameterized  by  more  parameters.  Mathematically, 
this  means  that  the  work  with  the  model  structure 

oo 

\Jgd{ty^{t))  (3.13) 

where  the  vector  6d  contains  d  parameters.  Typically  the  functions  ga  have  the  char- 
acter of  function  expansions  of  one  or  another  type.  If  <p(t)  is  scalar,  we  can  picture  gd 
as  any  function  approximation  scheme  over  the  real  axis,  like  polynomial  expansion 
to  degree  d,  piecewise  constant  functions  over  71  divided  into  d  intervals  and  so  on. 
After  a  model  structure  is  determined,  the  parameters  are  tuned,  so  that  behavior 
predicted  by  the  model  coincides  with  measurements  from  the  real  system.  Param- 
eter estimation  procedure  provides  a  search  through  parameter  space  effectively  to 
achieve  a  close-to  optimal  mapping  between  the  actual  values  of  the  system  and  the 
approximate  abstract  system.  Comprehensive  discussions  on  the  models  and  parame- 
ter estimation  procedures  are  found  in  Refs.  [44,  47,  43].  Appendix  shows  performance 
results  of  system  identification  methods  in  actual  applications. 
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Neural  Networks 

Neural  networks  have  been  established  as  a  general  approximation  tool  for  fit- 
ting models  from  input/output  data  [48,  49,  50,  51].  Backpropagation,  recurrent 
and  temporal  neural  networks  have  been  shown  to  be  applicable  to  identify  general 
systems  [52,  9,  10,  11,  40,  53]. 

Neural  network  topology  is  shown  in  Figure  3.4.  A  network  is  composed  of  non- 
linear computational  elements  called  cells,  which  are  organized  in  layers.  There  are 
three  kinds  of  layers:  the  input  layer,  the  hidden  layer (s),  and  the  output  layer.  The 
neural  network's  architecture  is  often  specified  using  notation  of  the  form  Li-L2-...Lf, 
where  Lx  denotes  the  number  of  cells  in  the  input  layer,  and  L2,...,Z//_i  denote  the 
number  of  cells  in  each  of  the  hidden  layers.  Lj  denotes  the  number  of  cells  in  the 
output  layer.  Each  cell  of  a  layer  is  connected  to  each  cell  of  any  previous  and  follow- 
ing layers  by  links,  which  represent  the  transmission  of  information  between  cells.  A 
set  of  weights,  associated  with  the  links,  characterizes  the  state  of  the  network.  We 
denote  the  weight  of  the  link  between  cell  j  and  cell  i  by  W{j.  The  weighted  sum  of  the 
output  Si,S2,---,Sn  of  the  n  cells  of  the  previous  layer,  J2j  *%  *  Sj,  is  calculated  first. 
The  output  of  the  layer,  S^  is  then  determined  by  a  nonlinear  function,  such  as  the 
sigmoid  function,  frequently  used  in  practice.  Figure  3.4  shows  the  output  calculation 
process.  The  parameter  6  is  called  a  threshold.  The  neural  network's  outputs  are 
the  outputs  of  the  cells  of  the  output  layer.  A  neural  network  learns  by  updating  its 
weights  according  to  a  learning  rule  used  to  train  it.  For  example,  Backpropagation 
networks  are  based  on  the  generalized  delta  rule.  This  algorithm  provides  a  method 
of  updating  the  weights  so  as  to  minimize  the  errors,  that  is,  the  differences  between 
the  desired  output  and  the  output  values  computed  by  the  neural  network.  Weights 
are  updated  during  the  learning  stage  according  to  examples  that  are  presented  to 
the  network.  For  example,  the  neural  network  computes  from  the  p  inputs  (which 
are  presented  as  input  values  to  the  input  layer)  the  n  predicted  outputs  (i.e.    the 
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Hidden  Layer(s) 


Inputs 


Outputs 


(a)  Neural  Network  Topology 


(b)  The  cell  level 


Figure  3.4.  Neural  network  topology:  A  neural  network  is  composed  of  cells,  which 
are  nonlinear  computational  elements  organized  in  layers.  The  cell  level  structure  is 
shown  in  (b) 


values  taken  by  the  cells  of  the  output  layer).  The  differences  between  the  predicted 
outputs  (computed  by  the  neural  network)  and  the  desired  outputs  (given  by  the  ex- 
ample) is  computed  and  back  propagated  (the  weights  are  modified  according  to  error 
gradient  computations)  [42,  54]. 

If  the  neural  network  learns  from  the  examples  generated  by  a  structural  abstrac- 
tion model,  the  neural  network  becomes  a  behavioral  abstraction  model.  The  powerful 
learning  capabilities  of  neural  networks  render  them  useful  to  predict  the  outputs  to 
a  simulation  model  given  to  its  inputs.  The  ability  of  certain  neural  networks  with  a 
sufficient  number  of  hidden  cells  to  approximate  nonlinear  functions  (i.e.,  the  simula- 
tion outputs  in  outs  case)  allows  them  to  compete  very  well  with  statistical  techniques 
in  terms  of  accuracy  [42].  To  be  used  as  a  behavioral  abstraction  model,  a  neural 
network  must  be  designed  and  trained  in  a  proper  manner.  Its  architecture  has  to  be 
designed  accordingly,  as  to  establish  a  mapping  between  1)  the  input  layer  and  the 
vector  of  the  p  input  variables,  and  2)  the  output  layer  and  the  vector  of  the  n  output 
variables.  Therefore,  the  neural  network  architecture  must  be  of  the  following  form: 
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Figure  3.5.  The  wavelet  network.  Dashed  arrows  figure  output  connections  to  other 
wavelons 

p  —  L2  —  ...,  —Lf_i  —n,  where  L2,  ...,L/_i  denote  the  number  of  cells  in  the  hidden  lay- 
ers. In  order  to  be  capable  of  predicting  output  values  from  input  values,  in  the  same 
way  as  the  simulation  model,  the  neural  network  must  be  trained  appropriately  [54]. 
The  performance  results  of  Backpropagation  neural  network,  Adaptive  Linear  Ele- 
ment neural  network  (ADALINE),  and  Gamma  temporal  network  are  shown  in  the 
Appendix. 

Wavelets 

Wavelet  decomposition  achieves  the  same  quality  of  approximation  with  a  network 
of  reduced  size  by  replacing  the  neurons  by  "wavelons",  i.e.  computing  units  obtained 
by  cascading  an  affine  transform  and  multidimensional  wavelets  [55].  For  a  wavelet 
function  ip  :  Rd  — >  R,  the  wavelet  network  is  written  as  follows 

71 

fn(x)  =  ^ulip{ai  *  (x  -  U)) 
1=1 

where  Uj  £  R,  a^  6  Rd,  ti  G  Rd,  and  "*"  means  component-wise  product  of  two 
vectors.  The  structure  of  the  wavelet  network  is  depicted  in  Figure  3.5  [55,  56]. 

Parameterized  function  family  in  system  identification  method  can  be  thought  of 
as  function  expansions 


g(<P,9)  =  Y,nk)9k(0) 


(3-14) 
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where  g^  are  the  basis  functions  and  the  coefficients  9(k)  are  the  coordinates  of  g 
in  the  chosen  basis.  Wavelet  networks  and  wavelet  transforms  are  used  for  the  basis 
functions,  g^.  Via  dilation  parameters,  wavelet  can  work  with  different  scales  simulta- 
neously to  pick  up  both  local  and  non-local  variations.  With  appropriate  translations 
and  dilations  of  a  single  suitably  chosen  function  k  (the  mother  wavelet),  we  can 
make  the  equation  3.14  orthonormal  [44].  The  choice  of  the  Gaussian  bell  function 
as  the  basic  function  without  any  orthogonalization  is  found  in  wavelet  networks  [55]. 
Parameter  9  is  estimated  by  minimizing  a  criterion  of  fit,  for  instance,  sum  of  squared 
error  or  norm.  We  use  Zhang's  wavelet  network  to  construct  estimators  with  non- 
orthogonal  wavelets.  Performance  results  of  the  wavelet  network  for  the  behavioral 
abstraction  technique  is  shown  in  the  Appendix. 
Discussions 

The  performance  of  three  abstraction  techniques  is  shown  in  the  Appendix.  Through- 
out this  chapter,  we  have  shown  behavioral  abstraction  techniques  available  in  differ- 
ent groups.  As  we  stated,  the  behavioral  abstraction  process  is  the  meta  modeling 
process;  therefore,  behavioral  abstraction  only  takes  place  after  the  structural  abstrac- 
tion and  the  input/output  data  sets  are  collected  enough  to  learn  the  relationship. 
By  combining  structural  abstraction  and  behavioral  abstraction,  we  have  the  advan- 
tages brought  by  both  types;  in  addition,  we  compensate  for  the  disadvantages  of  one 
abstraction  technique  from  another.  Advantages  from  behavioral  abstraction  process 
are  [42]  : 

1.  A  behavioral  abstraction  model  generally  needs  less  time  than  the  corresponding 
simulation  model  to  provide  the  results.  In  a  structural  abstraction  model,  the 
time  necessary  to  obtain  the  results  typically  depends  upon  such  criteria  as 
the  depth  of  the  abstraction  hierarchy  and  the  complexity  associated  with  each 
level  of  the  abstraction  hierarchy.     In  a  behavioral  abstraction  method,  the 
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computing  time  needed  is  constant;  it  only  depends  on  its  architecture,  for 
instance,  the  number  of  layers  and  number  of  cells  in  each  layer  in  the  case 
of  backpropagation  neural  network.  The  backpropagation  model,  for  instance, 
does  not  depict  the  dynamic  behavior  of  the  system,  but  only  transfers  the 
inputs  into  outputs  using  simple  arithmetic  operations,  so  that  the  resulting 
computing  time  is  generally  much  lower.  This  advantage  is  directly  used  for 
modeling  and  simulating  real-time  systems.  When  one  structural  abstraction 
model  is  much  simpler  than  the  behavioral  abstraction  model,  the  amount  of 
speedup  might  be  neglectable  or  even  negative.  However,  as  we  abstract  more 
components  of  the  structural  abstraction  model,  the  more  speed  up  we  generally 
can  get.  Therefore,  the  speedup  advantage  of  the  behavioral  abstraction  might 
be  increased  as  the  modeled  system  is  complex. 

2.  When  some  characteristics  of  the  system  can  change  over  time,  the  simulation 
model  should  be  modified  in  order  to  remain  valid.  Due  to  their  prediction 
capability  and  learning  capability,  the  behavioral  abstraction  model  is  capable 
of  updating  its  weights  according  to  new  examples  coming  directly  from  the 
system,  so  that  it  can  integrate  certain  changes  in  the  system  without  changing 
the  model  structure.  If  more  inputs  or  outputs  had  to  be  taken  into  account, 
the  behavioral  abstraction  structure  would  also  have  to  be  modified. 

Several  inconveniences  of  using  behavioral  abstraction  models  have  been  pointed  out. 

1.  The  development  of  behavioral  abstraction  models  may  be  time  consuming.  De- 
pending on  the  case  (number  of  inputs  and  complexity  of  the  system  behavior) 
and  the  precision  needed,  numerous  simulations  may  be  necessary  to  build  the 
training  set.  Moreover  the  selection  of  the  neural  network  parameters  and  the 
learning  phase,  for  instance,  are  also  likely  to  be  time  consuming. 


39 


2.  Precision  is  lost  compared  to  the  results  of  the  simulation  model.  The  preci- 
sion that  can  be  obtained  by  a  neural  network  depends  on  such  criteria  as  the 
"regularity"  of  the  behavior  of  the  system  under  study,  and  the  variance  of  the 
outputs. 

3.  Behavioral  abstraction  techniques  are  used  in  order  to  gain  insight  into  the 
relationships  between  inputs  and  outputs  of  the  system  under  study.  In  a  neural 
network  behavioral  abstraction  model,  for  instance,  the  knowledge  about  how 
the  inputs  are  transformed  into  outputs  is  represented  through  the  weights. 
Hence,  the  analysis  of  these  weights  may  provide  useful  insight  about  the  system 
behavior.  However,  the  information  contained  in  the  neural  network  weights  is 
not  explicit. 

The  first  inconvenience  of  the  behavioral  abstraction  can  be  overcome  by  com- 
bining the  structural  abstraction.  We  try  to  minimize  the  unit  that  the  behavioral 
abstraction  techniques  need  to  be  applied.  The  structural  abstraction  process  orga- 
nizes the  system  into  a  set  of  methods  and  defines  the  partial  orderings  among  the 
methods.  Therefore,  a  method  is  the  basic  unit  that  behavioral  abstraction  tech- 
niques are  applied  to.  The  number  of  input  parameters  and  output  parameters  for 
one  method  are  fairly  small;  therefore,  the  development  time  of  behavioral  abstrac- 
tion models  may  be  reduced.  The  second  inconvenience  can  be  overcome  from  our 
assumptions  in  Chapter  2.  Our  objective  is  to  achieve  the  high  level  goal  of  the  sys- 
tem. Sacrificing  solutions  are  acceptable  as  long  as  the  high  level  goal  of  the  system  is 
achieved.  Also,  by  applying  behavioral  abstraction  techniques  to  a  certain  component 
of  the  structural  abstraction  model,  we  minimize  the  propagation  of  the  precision  loss. 
For  example,  if  a  method  Mi  of  class  Cj  is  behaviorally  abstracted,  the  precision  loss 
from  Mt  is  localized  only  to  Cj.  Therefore,  the  precision  loss  from  Mt  is  minimized 
when  we  look  at  the  model  as  a  whole. 
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In  the  next  section,  we  show  the  implementation  of  the  proposed  abstraction 
methodology  in  OOPM/RT. 

3.3     Abstraction  Mechanism  of  OOPM/RT 

OOPM/RT  is  an  implementation  of  the  proposed  abstraction  methodology.  Mod- 
elers start  from  the  structural  abstraction  phase  and  then  apply  behavioral  abstrac- 
tion as  necessary.  OOPM/RT  supports  6  model  types  for  the  structural  abstraction 
phase  :  FBM,  FSM,  RBM,  SD,  EQM  and  CODE.  CODE  is  used  where  a  modeler 
cannot  characterize  the  system  with  a  specific  model  type.  Modelers  can  express  the 
knowledge  about  the  system  with  C++  syntax  in  CODE  method.  Each  model  type 
has  its  own  editor  to  help  a  modeler  easily  represent  his/her  mental  model  on  the 
computer,  as  shown  in  Figure  3.6.  More  detailed  discussions  on  HCI  components  for 
each  of  the  model  types  are  found  in  Refs.  [8]. 

Modelers  load  the  method  name  to  be  used  for  the  behavioral  abstraction.  The  se- 
lected method  will  approximate  all  the  structural  methods  inside  with  one  behavioral 
method.  Therefore,  the  behavioral  abstraction  method  will  not  go  to  the  bottom  level 
to  get  the  functional  semantics  associated  with  the  level.  The  input  and  output  pa- 
rameters of  the  selected  method  are  obtained  through  MMR  component  of  OOPM  [7] 
and  collected  for  the  first  step  of  behavioral  abstraction  process. 

The  second  step  of  behavioral  abstraction  process  is  to  fit  the  model  to  the  col- 
lected data.  Three  model  types  are  supported  in  OOPM/RT:  (1)  ADALINE  (Adap- 
tive Linear  Element)  neural  network,  (2)  Backpropagation  neural  network,  and  (3) 
Box-Jenkins  ARMA  model. 

The  ADALINE-based  behavioral  abstraction  method  is  created  in  Figure  3.7. 
The  adaptive  linear  element  was  developed  by  Widrow  and  Hoff.  Their  neural  net- 
work model  differs  from  the  perceptron  in  that  their  neurons  have  a  linear  transfer 
function.  This  allows  outputs  to  take  on  any  value,  as  opposed  to  just  the  ones 
and  zeros  of  the  perceptron.    It  also  enables  the  Widrow-Hoff  learning  rules,  also 
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known  as  the  Least  Mean  Square  (LMS)  rule,  to  adjust  weights  and  biases  according 
to  the  magnitude  of  errors,  not  just  their  presence  [43].  A  set  of  input  vectors  is 
used  to  train  a  network  (by  adjusting  its  weights  and  biases)  to  produce  the  cor- 
rect target  vector  upon  presentation  of  any  of  input  vectors.  Our  ADALINE  has 
delay  parameter  to  compose  the  temporal  input  vectors.  If  a  modeler  specifies  n 
for  delay  parameter,  {It-{n-\),  It-{n-2)i  ...,It-i,It)  is  composed  for  the  input  set  and 
(Ot_(„_i),Ot_(n_2),  ...,Ot-i,Ot)  is  composed  for  the  output  set.  Based  on  the  com- 
posed input/output  signals,  ADALINE's  learning  process  is  started.  A  learning  rate 
is  determined  by  a  modeler. 

Application  of  the  Widrow-Hoff  rule  may  not  result  in  a  perfect  network,  but 
the  sum  of  the  squared  errors  will  be  minimized,  provided  that  the  learning  rate  is 
sufficiently  small.  Changes  in  the  weights  and  biases  are  proportional  to  the  weight's 
effect  on  the  sum  of  the  squared  error  of  the  network.  This  is  an  example  of  a  gradient 
descent  procedure.  ADALINE  networks  can  be  trained  to  associate  input  vectors  with 
a  desired  output  and  to  approximate  any  reasonable  function  linearly  [43,  54]. 

The  backpropagation-based  behavioral  abstraction  method  is  generated  through 
an  user  interface  as  shown  in  Figure  3.8.  A  training  file  is  composed  of  input  signals 
and  target  signals,  while  a  test  file  is  composed  of  only  input  signals  to  test  the  gen- 
erated backpropagation  neural  network.  Weight  vectors  are  initialized  randomly  or 
with  a  pre-existing  data  file.  Modelers  specify  the  neural  network  structure;  1)  the 
number  of  layers,  and  2)  the  number  of  nodes  in  each  layer.  A  momentum  parameter 
and  a  noise  factor  can  be  specified  for  the  learning  process.  The  backpropagation 
learning  process  continues  until  either  the  learning  results  reach  the  specified  tol- 
erance or  the  neural  network  has  been  trained  for  the  specified  number  of  learning 
cycles.  Backpropagation  was  created  by  generalizing  the  Widrow-Hoff  learning  rule 
to  multiple  layer  networks  and  nonlinear  differentiable  transfer  functions.  Networks 
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Figure  3.7.  User  interface  for  ADALINE  behavioral  abstraction  process 

with  biases,  at  least  one  sigmoid  neuron  layer,  and  a  linear  output  neuron  layer  are 
capable  of  approximating  any  reasonable  function  [57]. 

Box-Jenkins  ARMA  model  is  implemented  for  the  behavioral  abstraction  process 
as  shown  in  Figure  3.8.  Input  signal  files  and  output  signal  files  are  specified  to  start 
the  learning  process.  Each  input/output  signal  has  a  minimum  lag  and  a  maximum 
lag,  each  of  which  specifies  how  many  past  signals  will  be  used  for  the  prediction.  If 
lag  of  an  input,  /,  is  3,  then  I(t)  is  determined  by  I(t  —  3),  I(t  —  2),  I(t  —  1),  and  the 
associated  weights  are  generated  through  the  Box-Jenkins  learning  process. 

Figure  3.7  shows  the  GUI  for  the  behavioral  abstraction  process.  The  learning 
result  is  plotted  in  a  plot  window,  while  the  text  outputs  are  shown  in  the  log  window. 
Based  on  the  final  weight  vectors,  a  C++  based  code  is  automatically  generated 
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Figure  3.8.  User  interface  for  the  behavioral  abstraction  process 

from  the  behavioral  abstraction  translator  discussed  in  Chapter  1.    The  behavioral 
abstraction  method  takes  the  following  structure  : 

MethodReturnType  Classname: :Methodname    (Input/Output  parameters) 
{ 

1.  Declaration  of   local  variables 

2.  Assigning  the  weight  vectors  which  has  been 
learned  from  the  behavioral  abstraction  process 

3.  Composing  input   signals  based  on  a  delay  or  a  lag 
parameter 

4.  Determining  output  parameters  based  on  the 
output  calculation  algorithms  of  the  behavioral 
abstraction  techniques 


The  output  of  the  simulation  method  is  compared  to  the  trained  output  from 
behavioral  abstraction  method.    The  sum  of  the  squared  error  or  RMS,  which  is  a 
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square  root  of  the  mean  of  the  squared  error,  are  presented  after  the  learning  process. 
The  error  measurements  are  listed  in  the  log  window  to  assess  the  validity  of  the 
generated  behavioral  abstraction  method. 

3.4     Summary 

As  we  model  more  complex  systems,  abstraction  is  an  essential  mechanism  to 
economically  represent  the  system  by  omitting  unnecessary  details  based  on  a  given 
simulation  objective.  The  proposed  abstraction  methodology  is  constructed  by  model 
engineering  perspective:  when  a  system  is  first  being  developed,  one  should  use  struc- 
tural abstraction  to  organize  the  whole  system  hierarchically  with  simple  system  types 
first,  and  then  graduate  to  more  complex  model  types.  Below  the  structural  abstrac- 
tion, each  component  is  a  black-box  with  no  detailed  internal  structure.  Behavioral 
abstraction  is  used  to  represent  the  black-box  by  approximating  the  behavior  of  the 
system  components.  By  combining  structural  and  behavioral  abstraction,  each  level 
of  abstraction  becomes  independent  from  the  rest  of  the  hierarchy,  so  a  level  can  be 
executed  alone,  unlike  the  traditional  hierarchical  modeling  methodologies  [39,  58]. 

We  discussed  several  abstraction  techniques  for  structural  and  behavioral  abstrac- 
tion process.  The  performance  of  each  technique  is  shown  in  the  Appendix.  We 
showed  how  to  overcome  the  disadvantages  of  structural  abstraction  by  behavioral 
abstraction,  and  how  to  cope  with  the  inconveniences  of  behavioral  abstraction  by 
using  structural  abstraction.  OOPM/RT  is  an  implementation  of  the  proposed  ab- 
straction methodology.  Modelers  capture  a  system  through  the  GUI  in  the  structural 
abstraction  process.  Learning  parameters  for  the  behavioral  abstraction  are  specified 
on  the  GUI  component.  Structural  abstraction  translator  accepts  the  pictures  which 
modelers  draw  in  the  structural  abstraction  process  and  automatically  translates  them 
into  C++  procedures.  Behavioral  abstraction  translator  receives  the  learning  results 
from  the  behavioral  abstraction  process.    Based  on  the  learned  weights  and  bias, 
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behavioral  abstraction  translator  automatically  constructs  C++  procedure  for  the 
behavioral  abstraction  methods. 

Multimodels  constructed  in  OOPM/RT  can  simulate  the  system  at  any  random 
level.  The  resulting  model  structure  provides  a  basis  where  the  timing  requirements 
inherent  to  real-time  systems  are  naturally  resolved.  The  basic  idea  is  to  control  the 
level  of  abstraction.  When  we  have  more  time  to  simulate  the  model,  we  use  a  low 
abstraction  level  for  the  constructed  model.  When  we  have  little  time  to  simulate 
the  model,  we  use  a  high  abstraction  level  to  deliver  the  simulation  results  by  a  given 
deadline  while  sacrificing  the  accuracy  of  the  model.  By  taking  a  high  abstraction 
level,  we  lose  structural  information  to  save  simulation  time. 

In  the  next  chapter,  we  present  a  methodology  to  control  the  abstraction  degree  in 
a  way  to  minimize  the  accuracy  loss,  while  satisfying  the  given  deadline  for  real-time 
simulation. 


CHAPTER  4 
MODEL  SELECTION  METHODOLOGY 


This  chapter  illustrates  how  we  handle  non-functional  requirements,  i.e.,  timing 
constraints,  inherent  to  real-time  systems.  In  Chapter  3,  we  showed  that  the  con- 
structed model  through  our  model  generation  methodology  can  simulate  the  system 
at  any  random  level.  Our  idea  to  guarantee  the  model's  timeliness  is  to  control 
the  level  of  abstraction  with  which  simulation  can  deliver  the  results  by  the  given 
amount  of  time.  The  determined  abstraction  level  is  optimal  in  the  sense  that  the 
resulting  model  will  satisfy  the  timing  constraint  and  minimize  the  accuracy  loss  that 
the  behavioral  abstraction  methods  might  yield  during  real-time  simulation.  A  lower 
abstraction  level  is  used  when  we  have  enough  time  to  simulate  the  base  model,  while 
a  higher  abstraction  level  is  needed  when  we  have  a  tight  deadline  to  meet.  This 
chapter  covers  the  second  and  third  phase  of  the  OOPM/RT  methodology,  which  are 
(1)  Arranging  a  set  of  models  under  the  abstraction  relationship  and  assessing  the 
quality/cost  for  each  model,  and  (2)  Executing  model  selection  algorithms  to  find 
the  optimal  model  for  a  given  deadline.  Through  these  two  phases,  we  guarantee  a 
model's  timeliness  at  design  time. 

In  Section  4.1,  we  first  propose  AT  structure  to  arrange  the  base  model  according 
to  the  abstraction  relationships.  Three  selection  algorithms  for  the  optimal  abstrac- 
tion model  are  proposed  in  Section  4.2  -  Section  4.4. 
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4.1     Construction  of  the  Abstraction  Tree 

AT  extends  the  tree  structure  to  represent  1)  all  the  methods  that  comprise  the 
base  model  and  2)  refinement/homomorphism  relationships  among  the  methods.  Ev- 
ery method  that  comprises  the  base  model  is  represented  as  a  node.  Each  node  takes 
one  of  three  types  :  Mi,  Ai  or  It. 

•  Mi  -  High  resolution  method.  It  takes  the  form  of  dynamic  or  static  meth- 
ods of  OOPM.  We  have  FBM  (Functional  Block  Model),  FSM  (Finite  State 
Machine),  SD  (System  Dynamics),  EQM  (EQuational  Model)  and  RBM  (Rule- 
Based  Model)  choices  for  the  dynamic  method,  and  the  CODE  method  for  the 
static  method. 

•  Ai  -  Low  resolution  method.  It  takes  the  form  of  a  neural  network  or  a  system 
identification  model. 

•  U  -  Intermediate  node  to  connect  two  different  resolution  methods,  Mi  and  Ai. 
Ii  appears  where  a  method  i  has  been  applied  to  behavioral  abstraction  and 
the  corresponding  behavioral  abstraction  method  has  been  generated  for  a  low 
resolution  method  to  speedup  the  simulation 

The  refinement/homomorphism  relationship  is  represented  as  an  edge.  If  a  method 
Mi  is  refined  into  A^,  N2,  N3, ...,  AT*  method,  an  edge(M;,  Nj),  for  j  =  1,2,...,  A;,  is 
added  to  the  AT.  AND/ OR  information  is  added  on  the  edge  to  represent  how  to 
execute  M;  for  a  given  submethod  Nj,  for  j  =  1, 2, ...,  k. 

•  AND  -  Mi  is  executed  only  if  Nj  is  executed,  V  j,  j  =  1, 2, ...,  k 

•  OR  -  Mi  is  executed  only  if  one  of  any  Nj,  j  —  1,2,  ...,k,  is  executed 

The  decision  of  AND/OR  is  made  based  on  1)  the  node  type  of  Mi  and  2)  the  model 
type  of  Mi. 
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1.  Node  type  :  An  intermediate  node  Ii  is  executed  either  by  Hi  or  Li,  where  Hi 
is  a  high  resolution  method  and  Lt  is  the  corresponding  low  resolution  method. 
Therefore,  Ii  is  connected  with  the  OR  relationship. 

2.  Model  type  :  If  a  method  Mi  takes  the  form  of  an  FBM,  and  each  of  the 
blocks  that  comprise  Mi  is  refined  into  B\,  B2,  ...,  Bk,  then  the  execution  of  Mj 
is  completed  when  Bj,  V  j,  j  =  1,2,  ...,k,  are  executed.  Therefore,  an  FBM 
method  Mj  is  connected  with  the  AND  relationship.  However,  other  model 
types  can  take  the  OR  relationship.  If  a  method  Mi  takes  the  form  of  FSM, 
and  each  state  of  the  FSM  is  refined  into  Si,  £2,  ■••,  S*,  then  the  execution  of 
Mi  is  completed  when  any  one  of  Sj,  j  —  1,2, ...,  k,  is  executed.  The  decision 
of  j  is  made  according  to  the  predicate  that  the  FSM  method,  Mj,  satisfies  at 
time  t.  Therefore,  FSM  method  Mt  is  executed  with  the  OR  relationship.  The 
decision  of  AND/OR  is  made  for  all  model  types  of  OOPM: 

(a)  AND  -  FBM,  SD,  EQM,  CODE  method 

(b)  OR  -  FSA,  RBM  method 

Each  node,  T,  in  AT  has  duration  D(T)  and  quality  Q(T).  Q(T)  summarizes  three 
properties  of  the  quality  associated  with  node  T. 

1.  QA(T)  -  Degree  of  abstraction.  Degree  of  abstraction  represents  how  much 
structural  information  would  be  lost  if  the  execution  occurs  at  node  T.  The  base 
model  will  not  be  executed  at  the  associated  leaf  nodes  when  the  method  T  is 
selected  for  the  behavioral  abstraction.  QA(T)  is  defined  by  how  many  methods 
are  being  discarded  if  behavioral  abstraction  occurs  at  node  T,  compared  to  the 
case  where  no  behavioral  abstraction  is  applied  to  the  base  model. 

2.  QI(T)  -  Degree  of  interest  loss.  A  modeler  may  specify  the  classes  which  he/she 
wants  to  observe  with  special  interest  throughout  the  simulation.    Degree  of 
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interest  loss  represents  how  much  interesting  information  will  be  lost,  if  the 
behavioral  abstraction  occurs  at  node  T.  As  we  minimize  the  use  of  behavioral 
abstraction  methods  to  the  interesting  methods,  the  more  appropriate  results 
may  be  produced.  QI(T)  is  defined  by  how  many  interesting  methods  are  being 
discarded  if  behavioral  abstraction  occurs  at  node  T,  compared  to  the  case 
where  no  behavioral  abstraction  is  applied  to  node  T. 

3.  QP(T)  -  Degree  of  precision  loss.  Degree  of  precision  loss  represents  how  ac- 
curately the  behavioral  abstraction  method  approximates  the  high  resolution 
method  for  node  T.  The  precision  can  be  assessed  by  testing  the  trained  neural 
network  or  system  identification  models.  Several  techniques  for  estimating  er- 
ror rates  have  been  developed  in  the  fields  of  statistics  and  pattern  recognition, 
which  include  hold  out,  leave  one  out,  cross  validation,  and  bootstrapping  [59]. 
The  holdout  method  is  a  single  train-and-test  experiment  where  a  data  set  is 
broken  into  two  disjoint  subsets-  one  used  for  training  and  the  other  for  testing. 
A  sufficient  number  of  independent  test  cases  are  needed  for  reliable  estima- 
tion. Leave  one  out  repeats  n  times  for  n  cases,  each  time  leaving  one  case  out 
for  testing  and  the  rest  for  training.  The  average  test  error  rate  over  n  trials 
is  the  estimated  error  rate.  This  technique  is  time-consuming  for  large  sam- 
ples. K-fold  cross-validation  repeats  k  times  for  a  sample  set  randomly  divided 
into  k  disjoint  subsets,  each  time  leaving  on  set  out  for  testing  and  the  others 
for  training.  Thus,  we  may  call  this  technique  "leave  some  out",  and  "leave 
one  out"  is  a  special  case  of  this  general  class.  Bootstrapping  is  a  method  for 
random  resampling  and  replacement  for  a  number  of  times,  and  the  estimated 
error  rate  is  the  average  error  rate  over  the  number  of  iterations.  The  basic  idea 
behind  error  estimation  or  validation  is  that  the  test  set  must  be  independent 
of  the  training  set,  and  the  partition  of  a  sample  into  these  two  subsets  should 
be  unbiased.  Moreover,  the  respective  sample  size  should  be  adequate,  and  the 
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estimated  error  rate  should  refer  to  the  test  error  rather  than  the  training  error 
rate.  To  maximize  the  use  of  every  sample,  it  is  preferable  to  take  each  case  for 
training  at  one  time  and  for  testing  at  another  [54].  Our  focus  is  not  to  propose 
a  new  error  estimation  method.  Instead,  we  use  the  available  error  estimation 
methods  to  properly  assess  QP(T)  for  the  behavioral  method  of  node  T. 


Based  on  the  three  properties,  Q(T)  is  defined  by  : 


QMT)   = 


QI(T) 


N 
Ni(T) 


QP(T)    =    E{T) 
Q,T)    =    QA(T)  +  QI(T)  +  QP(T) 


where  N(T)  for  the  number  of  nodes  in  a  subtree  that  has  T  as  a  root  node,  iVj(T) 
for  the  number  of  interesting  nodes  in  a  subtree  that  has  T  as  a  root  node,  TVj  for  the 
total  number  of  interesting  nodes  in  a  given  AT  and  N  for  the  total  number  of  node 
in  a  given  AT.  E(T)  is  the  normalized  error  rate  of  behavioral  abstraction  method  for 
node  T,  which  is  estimated  from  one  of  the  techniques  previously  discussed.  N(T) 
of  QA(T)  is  set  to  1  for  a  leaf  node,  q  represents  the  number  of  quality  properties 
specified  for  node  T  (1  <  q  <  3).  For  an  intermediate  node,  7j 

Q(Ii)    =    Q(Hi)-Q(Li) 

where  Hi  is  the  high  resolution  method  for  node  I{  and  Lj  is  the  low  resolution  method 
for  node  7^. 

We  assume  that  duration  (cost,  execution  time)  of  the  leaf  methods  has  been  well 
assessed  by  the  time  estimation  techniques  available  in  real-time  system  literature  [60, 
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61].  D(T)  is  defined  based  on  AND/OR  relationship  and  node  types.  For  a  node  type, 
Ii,  and  the  corresponding  two  different  resolution  models,  Hi  and  L;, 

D(Ii)    =    D(Hi)  -  D(Lt)  +  0 

where  9  represents  system  factor,  9  considers  if  the  target  platform  is  different  from 
the  environment  in  which  the  execution  time  has  been  measured.  Therefore,  D(Ii) 
represents  the  amount  of  speedup  that  the  behavioral  abstraction  method  makes  for 
the  base  model  in  any  platform.  For  other  node  types,  duration  of  a  node  is  defined 
based  on  its  AND/OR  relationship.  For  an  AND  related  node, 

k 
D(T)    =    52  Nj  +  S(T)  +  9 

For  an  OR  related  node, 

D(T)    =    Max(N1,N2,...,Nk)  +  6(T)+9 

where  Nj,  for  j  =  1, ...,  k,  is  the  method  that  T  calls  to  complete  its  high  resolution 
execution  and  k  is  the  number  of  children  nodes  that  the  node,  T,  has.  S(T)  is  the 
amount  of  time  that  method  T  takes  for  its  own  execution.  For  example,  in  the 
case  of  an  FSM,  checking  the  current  state  and  determining  the  next  state  based  on 
the  predicates  might  take  8(T)  time,  while  the  execution  of  each  state  is  assessed 
in  the  summation  term.  9  is  a  system  factor  as  in  the  case  of  Ii  node.  D(T)  of  an 
OR  node  is  set  to  the  worst  case  execution  time  by  taking  the  maximum  duration 
of  the  possibilities.  This  worst  case  assignment  securely  guarantees  the  resulting 
model's  timeliness.  The  quality  and  duration  function  are  constructed  recursively 
until  individual  methods  at  the  leaf  level  are  reached. 

Figure  4.1  shows  an  example  of  AT.  M2\  is  an  AND  related  method  that  calls 
M31  and  then  M32  followed  by  M33.   M2i  is  an  AND  related  method  that  calls  M34 
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220 


All  20 


M31    A31     M32    A32     M33    A33 

30  20  60  20  40  20 


M34    A34     M35    A35 

40         20  70  20 


Figure  4.1.  Example  of  AT  (Abstraction  Tree) 

and  then  M35.  A  method  Mn  calls  M2i  and  then  M22-  We  suppose  that  a  behavioral 
abstraction  method  {^n,  Ai2, ...,  ^35}  has  been  generated  for  each  of  the  correspond- 
ing high  level  method  Mij.  Each  Aij  may  take  different  model  type  according  to  the 
behavioral  abstraction  technique.  The  intermediate  nodes  relate  a  high  resolution 
method  to  a  corresponding  behavioral  abstraction  method.  These  nodes  are  sym- 
bolized by  {/n,/i2,"-5^35}-  ^  all  {hi,  I\2,  —■>  hs}  are  executed  by  high  resolution 
methods  only,  the  resulting  structure  is  the  base  model  which  has  been  constructed 
through  the  structural  abstraction  process.  The  quality  and  duration  of  each  node  is 
determined  by  recursively  applying  the  quality  and  duration  equations.  S  and  9  are 
assumed  to  be  0  for  each  internal  node  in  Figure  4.1. 

4.2     Selection  of  the  Optimal  Abstraction  Level 

Under  uniprocessor  scheduling,  a  schedule  is  an  assignment  of  the  CPU  to  the  real 
time  tasks  such  that  at  most  one  task  is  assigned  to  the  CPU  at  any  given  amount. 
More  precisely,  a  schedule  is  a  set  of  A  of  execution  intervals  described  as  : 

A  =  {(sufi,U)\i=  l,-.,n} 
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where  s;  is  the  start  time  of  the  interval,  fi  is  the  finish  time  of  the  interval,  and 
ti  is  the  task  executed  during  the  interval.  The  schedule  is  valid  if: 

1.  For  every  i  =  1,...,  Sj  <  fi 

2.  For  every  i  =  1, ...,  /,  <  si+1 

3.  If  U  =  k,  then  Sk  <  Sj  and  fi  <  Dk 

where,  Sk  is  the  release  time  and  Dk  is  the  deadline.  Condition  1  requires  that 
execution  intervals  are  really  intervals.  Condition  2  requires  that  the  intervals  be 
time  ordered.  Condition  3  requires  that  a  task  only  be  executed  between  its  release 
time  and  its  deadline.  A  task  set  is  feasible  if  every  task  r^  receives  at  least  Ck  seconds 
of  CPU  execution  in  the  schedule.  More  precisely,  let 

A(Tk)  =  {a  =  (si,fi,ti)\a  e  AandU  =  k} 

Then,  the  schedule  is  feasible,  if  for  every  r^  6  V, 


X!        fi~  Si>Ck 

(si,fi,k)eA(Tk) 


A  set  of  tasks  is  feasible  if  there  is  a  feasible  schedule  for  the  tasks.  The  goal  of 
real-time  scheduling  algorithms  is  to  find  a  feasible  schedule  whenever  one  exists. 

In  a  schedule  that  satisfies  the  0/1  constraint  (the  system  must  either  execute  a 
task  to  completion  before  its  deadline  or  not  schedule  it  at  all)  and  timing  constraints, 
as  well  as  to  minimize  the  total  error,  is  NP-complete  when  the  tasks  have  arbitrary 
processing  time.  A  task  is  a  granule  of  computation  treated  by  the  scheduler  as  a 
unit  of  work  to  be  allocated  processing  time.  In  our  case,  task  corresponds  to  method 
that  comprises  the  base  model.  Similarly,  a  task  group  corresponds  to  a  method  that 
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calls  other  submethods  to  complete  its  execution.  Then,  the  problem  of  selecting  the 
optimal  abstraction  level  translates  to  the  scheduling  problem,  which  is  a  process  of 
finding  an  ordered  set  of  methods  that  satisfies  the  conditions  of  the  valid  schedule 
and  maximize  tradeoffs  of  quality  for  time.  We  select  V  methods  among  V  methods 
in  a  way  to  achieve  all  given  deadlines,  as  stated  in  the  condition  1-3.  Moreover, 
the  selected  task  set,  V,  achieves  the  best  tradeoff  quality  for  time  (minimizes  the 
total  quality  loss  for  a  given  amount  of  time).  Therefore,  the  selection  of  the  optimal 
abstraction  level  is  as  hard  as  the  scheduling  problem.  More  detailed  analysis  on  the 
complexity  of  the  optimal  scheduling  problem  is  found  in  Refs  [62,  17,  63]. 

Section  4.3  and  4.4  present  three  algorithms  for  scheduling  a  set  of  real-time  tasks, 
equivalently  saying,  the  algorithms  for  determining  the  optimal  abstraction  level  that 
produces  an  optimal  schedule.  We  assume  that  there  are  no  interactions  between  task 
groups.  The  optimal  scheduling  set  V  is  constructed  by  : 

1.  Apply  the  proposed  scheduling  algorithms  to  each  independent  task  group, 
ii,  ...,£„.  Let  ti  produce  the  scheduling  result  <5j. 

2.  Collect  the  result  from  each  task  group  and  form  the  complete  trajectory, 

(6u...,5n) 

Without  loss  of  generality,  we  assume  that  the  base  model  is  composed  of  one  task 
group.  Therefore,  the  proposed  algorithms  will  be  applied  to  the  entire  AT. 

4.3     IP  (Integer  Programming)-Based  Selection 

Two  Integer  Programming  (IP)-based  techniques  for  the  optimal  abstraction  level 
are  presented:  IP1  and  IP2.  Operations  Research  (OR)  is  a  field  that  is  concerned 
with  deciding  how  to  design  and  operate  systems  optimally  under  the  conditions 
requiring  the  allocation  of  scarce  resources.  Our  optimal  level  selection  problem  falls 
under  the  OR  umbrella,  since  the  selection  should  be  made  for  the  best  model  that  has 
an  optimal  abstraction  level  to  simulate  a  given  system  under  conditions  requiring 
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the  allocation  of  scarce  resources,  such  as  time  and  accuracy.  The  essence  of  the 
operations  research  activity  lies  in  the  construction  and  the  use  of  mathematical 
models.  The  term  linear  programming  defines  a  particular  class  of  programming 
problems  when  the  problem  is  defined  by  a  linear  function  of  the  decision  variables 
(referred  to  as  the  objective  function),  and  the  operating  rules  governing  the  process 
can  be  expressed  as  a  set  of  linear  equations  or  linear  inequalities  (referred  to  as  the 
constraint  set)  [64].  Integer  programming  refers  to  the  class  of  linear  programming 
problems  wherein  some  or  all  of  the  decision  variables  are  restricted  to  integers.  Pure 
integer  programming  is  the  problem  where  all  the  decision  variables  are  restricted  to 
integer  values.  Our  problem  is  a  special  case  of  IP  where  the  decision  variables  take 
binary  values  to  indicate  whether  or  not  to  select  the  examining  node  of  a  given  AT 
for  the  behavioral  abstraction.  Several  algorithms  are  developed  to  determine  the 
optimal  integer  solution.  In  practice,  the  Branch  and  Bound  algorithm  [64]  is  the 
most  widely  used  method  for  solving  integer  programming  problems.  Basically,  the 
branch  and  bound  algorithm  is  an  efficient  enumeration  procedure  for  examining  all 
possible  integer  feasible  solutions. 

We  formulate  the  problem  as  two  IP  models  in  Section  4.3.1.  A  simple  example 
is  given  to  illustrate  the  proposed  methods  in  Section  4.3.2. 

4.3.1     Formulation 

Let  a  binary  integer  variable  L^  denote  the  decision  to  select  or  not  to  select  the 
node  lij  for  the  behavioral  abstraction. 

T  1    if  behavioral  abstraction  occurs  at  the  1^  node 

!J      |  0    otherwise 

Then,  the  objective  function  for  IP  I  selection  is  defined  in  equation  4.1 


I      n, 

Minimize  2_]  5Z  ^*i  (4-1) 

i=l  j=i 
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subject  to 


l      n, 

Y,J2aiJLV    ^    ac  (4-2) 

»=l7'=l 

I      n, 

YtYtUjUj  >  tc  (4.3) 

1=1  j=i 


and,  for  each  parent  node  La-  of  a  given  AT 


5Z  Li+hk  <  ni(l  ~  Lik),  for  each  i  (4.4) 

fc=i 


where  /  is  the  maximum  level  of  the  AT  and  n*  is  the  number  of  nodes  at  level  i. 
Ojj  represents  the  quality  loss  and  Uj  represents  the  expected  duration,  which  are 
assessed  by  the  equations  in  Section  4.1.  ac  defines  the  accuracy  constraint  given  to 
the  system,  while  tc  is  the  amount  of  desired  speedup  to  meet  a  given  deadline,  D. 
Therefore,  tc  =  execution  time  of  the  base  model  -  D. 

The  objective  function  reflects  the  fact  that  the  smaller  number  of  behavioral 
abstraction  methods  is  desirable  as  long  as  the  resulting  model  satisfies  the  given 
time  deadline  and  accuracy  constraint.  IP1  is  useful  when  a  simulation  objective  is 
to  minimize  the  loss  of  structural  information  as  long  as  the  desirable  speedup  and 
accuracy  are  guaranteed. 

The  objective  function  for  IP2  selection  is  defined  in  equation  4.5 

l      n, 

Minimize  "^2^2  aijLij  (4.5) 

i=i  j=i 


subject  to 


(       n, 

EE*iA  >  *c  (4.6) 

i=i  j=i 
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and,  for  each  parent  node  Lik  of  a  given  AT 


Yl  £*+l,*  ^  ni(!  ~~  ^**)>    for  each  *  (4-7) 

fc=l 


The  objective  function  of  IP2  minimizes  expected  quality  loss  while  satisfying 
the  timing  constraint  defined  in  equation  4.6.  IP2  is  useful  when  the  objective  of 
simulation  is  to  minimize  the  total  quality  loss  and  does  not  necessarily  minimize 
the  loss  of  structural  information.  For  instance,  if  a  model,  A,  which  cuts  out  three 
structural  components  and  is  expected  to  produce  more  accurate  results  than  a  model, 
B,  which  cuts  out  only  one  structural  model,  IP2  keeps  A  for  a  candidate  of  the 
optimal  abstraction  model. 

4.3.2     Analysis 

Consider  AT  in  Figure  4.1.  We  associate  each  Itj  node  with  a  binary  variable  Ljj 
discussed  in  the  previous  section.  Then  the  objective  function  of  IP1  for  a  given  AT 
is  defined  as  : 

Minimize  (Ln  +  L2\  +  L22  +  L3i  +  L32  +  £33  +  L34  +  L35)  (4.8) 

For  simplicity,  we  assume  that  any  behavioral  abstraction  method  takes  20  units. 
9  is  assumed  to  be  0,  which  means  real-time  simulation  will  be  performed  in  the  same 
platform  with  which  the  expected  duration  has  been  measured.  Then,  t{j  is  defined 
as  follows: 

tn  =  240  -  20  =  220 
t21  =  130  -  20  =  110 
t22    =110-20    =90 
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*3i  =30-20  =10 

t32  =60-20  =40 

£33  =40-20  =20 

«34  =40-20  =20 

t35  =70-20  =50 


For  the  simplicity  of  illustration,  we  consider  only  QA(Iij)  to  assess  the  quality 
loss,  dij,  when  the  corresponding  node  Itj  is  selected  for  the  behavioral  abstraction. 
Then,  a^  is  simplified  as  follows: 


13  N 


where  dj  is  the  number  of  children  that  Lij  has.  Since  the  behavioral  abstraction 
at  this  level  discards  all  the  structural  information  of  the  lower  levels,  we  believe  that 
the  accuracy  loss  is  proportional  to  the  number  of  descendants  that  a  node  has.  The 
right  hand  side  of  a^  is  to  find  out  the  number  of  descendants  that  node  L^  has.  For 
a  given  AT  in  Figure  4.1,  a^  is  defined  as  follows. 


«31  =| 

°32  =  J 

°33  =1 

034  =  I 

a35  =  I 

«21  =   I 
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a22        =| 

_  _   2+2+3      _   £ 

Then,  for  a  given  accuracy  loss  constraint,  ac,  the  accuracy  constraint  is  defined  as  : 

(anLn  +  a2\L2\  +  a22L22  +  a3iL3i  +  a32L32  +  a33L33  +  a3iL3i  +  a35L35)  <  ac  (4.9) 
Also,  for  a  given  time  constraint,  tc,  the  speedup  constraint  is  defined  as  : 

(tiiLn  +  t2\L2\  +  ^22-^22  +  ^31-^31  +  ^32-^32  +  G33L33  +  (Z34Z/34  +  a3f,L3f,)   >  tc    (4.10) 

To  define  parent  and  child  relationships  in  the  given  AT,  we  have  a  set  of  equations 
for  all  the  child  nodes  of  the  given  AT. 

L3i  +  L32  +  L33  >  3(1  —  Z/21) 
L34  +  L35  >2(1-L22) 
L2l+L22    >2(1-Ln) 

are  equivalent  to, 

3L2i  +  L3\  +  L32  +  L33    >  3 

2L22  +  L34  +  L35  ^2  (4-n) 

2Ln  +  Z/21  +  L22  >  2 

Then,  the  IP  I  selection  of  the  optimal  abstraction  level  for  a  given  AT  is  to  solve 
the  objective  function  defined  in  equation  4.8  subject  to  the  constraints  defined  in 
equations  4.9-  4.11. 

Figure  4.2  shows  the  result  when  we  have  120  units  for  a  deadline(£c  =  120)  and 
(50%)  for  an  accuracy  constraint(ac  =  0.5).  The  answer  suggests  that  applying  be- 
havioral abstraction  at  L2\  and  L34  gives  the  optimal  abstraction  level  that  simulates 
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of  Lij 


Results 


Figure  4.2.  Solver  solution  when  a  given  deadline  is  120  and  accuracy  loss  is  50% 

the  system  within  a  given  deadline  while  satisfying  the  accuracy  constraint.  An  alter- 
native solution  is  L22  and  L32,  which  also  achieves  given  time  and  accuracy  constraint 
as  shown  in  Table  4.1.  Figure  4.3  shows  the  corresponding  AT  for  these  constraints. 
hi  node  is  executed  by  its  behavioral  abstraction  method,  A2\-  Also,  I34  node  is 
executed  by  its  behavioral  abstraction  method,  A34,  instead  of  the  high  resolution 
method,  M34.  Other  intermediate  nodes  (735,  I22,  hi)  are  executed  by  the  high  res- 
olution methods.  The  intermediate  nodes,  73i,  732,  and  733  are  not  considered  since 
the  behavioral  abstraction  occurs  at  the  parent  node  hi-  The  execution  time  of  the 
AT  is  saved  by  the  speedup  amount  of  A21  and  A34. 

We  omit  the  analysis  of  IP2,  since  the  execution  steps  are  basically  equal  to  IP1, 
except  the  objective  function  and  the  constraint.  The  objective  function  of  IP2  is 
defined  as: 


Minimize(auLn  +  a2iL2i  +  022^22  +  031-^31  +  o32L32  +  a33L33  +  aML34  +  a35L35) 
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An  20 


Figure  4.3.  Optimal  abstraction  tree  decided  from  the  proposed  integer  programming 
approach 

subject  to 

(tiiLn  +  ^2lZ/21  +  ^22^22  +  ^31-^31  +  ^32-^32  +  O33L33  +  (I34L34  +  (I35Z/35)  >  tc 

The  worst  case  running  time  of  IP1  and  IP2  is  determined  by  the  magnitude  of  the 
values  of  variables  in  an  optimal  solution  to  the  pure-integer  programming  problem. 
An  instance  of  IP1  and  IP2  problem  is  defined  as  : 


min{cx  :  Ax  <  b,  x  £  Bn] 

The  instance  is  specified  by  an  integral  mx(n  +  1)  matrix  (A,b)  and  an  integral  n- 
vector  c,  where  m  is  the  number  of  integer  variables  in  the  objective  function  and  n 
is  the  number  of  inequality  constraints.  The  problem  can  be  solved  by  a  brute-force 
enumerative  algorithm  (such  as  the  branch-and-bound  method)  in  0(2nmn)  [65]. 
Therefore,  the  time  complexity  of  IP  I  and  IP2  is  defined  as  : 


0{2nmn) 


where  m  is  the  number  of  I-nodes  in  the  given  AT.  n  is  determined  by 
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k+l  2    IP1 
K+\l    IP2 

where  k  is  the  number  of  parent  and  child  relationships  among  the  given  I-nodes.  IP1 
has  two  additional  equations  for  accuracy  and  time  constraints,  while  IP2  has  one 
additional  equation  for  time. 
4.3.3     Experiments 

We  implemented  the  proposed  integer  programming  solution  with  solver  on  Excel. 
For  a  small  problem  space  as  in  the  case  of  Figure  4.1,  solver  of  Excel  might  be  a 
good  choice.  However,  if  the  problem  size  is  large,  we  can  use  CPLEX  [66]  which  is 
an  optimization  callable  library  designed  for  large  scale  problems. 

For  the  exact  solution  method,  we  use  the  branch  and  bound  method,  a  classical 
approach  to  find  exact  integer  solutions.  Through  the  branch  and  bound  method,  the 
binary  variable  Lij  is  either  0  or  1. 

Table  4.1  shows  some  results  from  IP1  selection.  Except  case  10  and  12,  solver 
found  the  optimal  solution  for  a  given  time  and  accuracy  constraint.  Case  10  and  12 
explain  the  situation  where  the  given  accuracy  constraint  is  too  tight  to  be  achieved 
within  the  given  deadline.  Relaxing  the  accuracy  constraint  gives  the  answer,  as  we 
can  see  in  cases  11  and  13.  When  the  base  model  meets  a  given  deadline,  as  in  case  1, 
no  behavioral  abstraction  is  suggested.  Also,  when  a  given  deadline  is  immediate,  the 
entire  AT  is  behaviorally  abstracted  into  one  method  as  in  case  15.  Other  cases  employ 
one  or  two  behavioral  abstraction  methods  to  meet  a  given  accuracy  constraint,  while 
satisfying  a  time  constraint. 

Table  4.2  shows  some  results  from  IP2  selection.  Note  that  the  number  of  selected 
nodes  are  equal  to  or  greater  than  the  cases  of  IP1.  This  is  because  the  loss  of 
structural  information  is  not  minimized  as  long  as  the  quality  loss  is  minimized.  Case 
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Table  4.1.   Experiment  results  from  IP1  for  the  selection  of  the  optimal  abstraction 
level 


No 

Deadline 

ac 

tc 

Selected  node 

Achieved  ac 

Achieved  deadline 

1 

240 

0.5(50%) 

0 

n/a 

0 

240 

2 

220 

0.5(50%) 

20 

L34 

0.125(13%) 

220 

3 

200 

0.5(50%) 

40 

£35 

0.125(13%) 

190 

4 

180 

0.5(50%) 

60 

L22 

0.25(25%) 

150 

5 

160 

0.5(50%) 

80 

L22 

0.25(25%) 

150 

6 

140 

0.5(50%) 

100 

L21 

0.375(38%) 

130 

7 

120 

0.5(50%) 

120 

L21,  £34 

0.5(50%) 

110 

8 

100 

0.5(50%) 

140 

-^21)   £35 

0.5(50%) 

80 

9 

80 

0.5(50%) 

160 

L2I1  £35 

0.5(50%) 

80 

10 

60 

0.5(50%) 

180 

infeasible 

- 

- 

11 

60 

0.7(70%) 

180 

L21,  L22 

0.625(63%) 

40 

12 

40 

0.7(70%) 

200 

infeasible 

- 

- 

13 

40 

0.9(90%) 

200 

Lu 

0.875(88%) 

20 

14 

20 

0.9(90%) 

220 

lm 

0.875(88%) 

20 

11  shows  different  result  from  IP1  selection,  as  the  objective  of  IP2  is  to  minimize  the 
expected  quality  loss  rather  than  to  minimize  the  amount  of  structural  information. 

4.4     Search-Based  Selection 


Our  hypothesis  is  that  as  we  need  more  tight  time  constraints,  we  tend  to  employ 
more  behavioral  abstraction  methods.  We  increase  the  number  of  behavioral  abstrac- 
tion methods  as  we  require  tighter  deadlines  for  the  search  heuristic.  The  selection 
algorithm  starts  from  one  behavioral  abstraction.  If  this  abstraction  satisfies  the 
time  constraint,  we  stop  and  do  not  go  further  to  examine  other  possibilities,  with 
the  understanding  that  increasing  the  number  of  behavioral  abstraction  methods  will 
result  only  in  a  less  accurate  model.  If  the  time  cannot  be  met  by  one  behavioral 
abstraction  method,  we  examine  how  many  behavioral  abstraction  methods  will  be 
needed  for  a  given  time  constraint.  This  is  done  by  examining  r  fast  behavioral  ab- 
straction methods.   If  combining  r  fast  behavioral  abstraction  methods  satisfies  the 
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Table  4.2.   Experiment  results  from  IP2  for  the  selection  of  the  optimal  abstraction 
level 


No 

Deadline 

tc 

Selected  node 

Achieved  ac 

Achieved  deadline 

1 

240 

0 

n/a 

0 

240 

2 

220 

20 

L34 

0.125(13%) 

220 

3 

200 

40 

£35 

0.125(13%) 

190 

4 

180 

60 

L32,  L34 

0.25(25%) 

180 

5 

160 

80 

L22 

0.25(25%) 

150 

6 

140 

100 

L>22,   L33,   L35 

0.375(38%) 

80 

7 

120 

120 

£22.  L32 

0.375(38%) 

110 

8 

100 

140 

L22,  L32,  £33 

0.5(50%) 

90 

9 

80 

160 

L21,  £35 

0.5(50%) 

80 

10 

60 

180 

L21,  L22 

0.625(63%) 

40 

11 

40 

200 

L2\,  L22 

0.625(63%) 

40 

12 

20 

220 

Lu 

0.875(88%) 

20 

time  constraint,  then  the  optimal  abstraction  level  will  be  determined  by  r  behavioral 
abstraction  functions.  At  this  point,  we  pick  r  behavioral  abstraction  functions  until 
the  most  accurate  combination  is  found  which  still  satisfies  the  given  time  constraint. 
Algorithm  1  shows  the  overall  method  in  detail. 
4.4.1     Analysis 

This  algorithm  reads  abstraction  information  about  a  given  base  model.  The 
information  contains  methods,  parent/child  relationships  between  the  nodes,  and 
duration/quality  information  for  each  method.  Based  on  the  given  information,  the 
algorithm  constructs  an  AT  as  in  the  first  line.  The  execution  time  of  the  base 
model  that  has  no  behavioral  abstraction  methods  is  calculated  in  Line  2.  Lines  3 
-  5  examine  whether  we  need  to  employ  behavioral  abstraction  methods  to  meet  a 
given  deadline.  If  the  calculated  duration  of  the  base  model  is  less  than  or  equal 
to  the  given  deadline,  we  do  not  have  to  employ  behavioral  abstraction  methods; 
thus,  the  algorithm  terminates.    If  the  duration  of  the  base  model  is  greater  than 
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Algorithm  1.  Optimal  Abstraction  Level  Selection 


1 
2 
3 

4 
5 
6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 


nodes  <=  at.  Construct  AT  (fid) 
baseCost  <=  nodes[0j.getCost() 
if  baseCost  <  deadline  then 

return (0) 
endif 

at.CollectOrNodes(nodes,orNodes) 
size  <=  at. SelectOneByDeadline(orNodes, deadline) 
if  size  >  0  then 

at.SelectByAccuracy(orNodes) 
OptimalAbstraction  <=  orNodes[0].getName() 
else 

degree  <=  OptimalAbsNumber(orNodes, deadline, baseCost) 

if  degree  ==  -1  then 
return  (-1) 

else 
OptimalSet  -4=  OptimalCombination(ornodes, deadline, baseCost,degree) 
OptimalCost  <=  OptimalSet. cost 
OptimalQualityLoss  <=  OptimalSet. qualityloss 

end  if 
end  if 
return(O) 


the  given  deadline,  then  it  becomes  necessary  to  use  behavioral  abstraction  methods. 
Upon  recognizing  the  necessity  of  using  behavioral  abstraction  methods,  the  algorithm 
collects  OR  nodes  that  contain  the  information  about  the  behavioral  abstraction 
methods.  Line  7-8  examine  whether  one  behavioral  abstraction  method  will  resolve 
the  timeliness  requirement.  If  the  returned  size  is  greater  than  0,  as  in  Line  9,  we 
know  that  one  behavioral  abstraction  is  enough  to  meet  a  given  deadline.  Then,  the 
algorithm  looks  up  the  most  accurate  method  to  ensure  that  the  selected  method  will 
have  the  best  quality  while  satisfying  the  given  deadline.  If  one  behavioral  abstraction 
is  not  enough  (size  <  0),  the  algorithm  determines  how  many  behavioral  abstraction 
methods  can  achieve  the  given  deadline.  If  we  increase  the  number  of  behavioral 
abstraction  methods  to  be  used  in  the  base  model,  then  the  simulation  time  of  the 
base  model  will  be  reduced.    Our  objective  is  to  minimize  the  usage  of  behavioral 
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abstraction  methods  as  long  as  the  resulting  model  meets  the  given  deadline.  A  simple 
method  is  : 

1.  i  =  2 

2.  select  i  behavioral  methods  that  will  bring  the  maximum  time  savings  to  the 
given  base  model; 

3.  if  the  use  of  i  behavioral  methods  can  not  resolve  the  required  speedup,  increase 
i  by  1  and  go  to  step  2; 

degree  in  Line  12  is  determined  by  this  method. 

At  this  point,  the  algorithm  knows  how  many  behavioral  abstraction  methods 
will  be  needed  for  a  given  deadline.  If  the  returned  degree  is  —1,  it  means  the  given 
deadline  cannot  be  met  even  if  we  use  all  available  behavioral  abstraction  methods. 
Lines  16-18  look  for  the  best  combination  that  will  lead  the  most  accurate  model. 
The  algorithm  examines  all  nCr  combinations,  where  n  represents  the  number  of 
behavioral  abstractions  available  to  the  given  base  model  (the  number  of  I-nodes  in 
the  given  AT)  and  r  is  the  calculated  degree  in  Line  13,  0  <  r  <. 
4.4.2     Experiments 

We  use  Figure  4.1  for  the  experiments.  The  accuracy  constraint  ac  is  set  to  1.0  for 
all  cases;  therefore,  we  do  not  have  the  results  as  shown  in  case  10  and  12  of  Table  4.1. 
The  results  are  same  as  in  the  cases  of  IP1  approach  except  in  case  7.  Since  the  search- 
based  approach  always  finds  the  minimum  accuracy  loss  while  minimizing  the  number 
of  behavioral  abstraction  methods,  we  select  L22  and  L32.  Table  4.3  summarizes  the 
results. 

4.5     Composition  of  the  Optimal  Abstraction  Model 

Given  an  optimal  abstraction  level  determined  by  the  selection  algorithms,  the 
Optimal  Abstraction  Model  Composer  looks  at  the  methods  that  will  be  used  for  the 
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Table  4.3.  Experiment  results  from  the  search-based  approach  for  the  selection  of  the 
optimal  abstraction  level 


No 

Deadline 

Or 

tr 

Selected  node 

Achieved  ac 

Achieved  deadline 

1 

240 

0.5(50%) 

0 

n/a 

0 

240 

2 

220 

0.5(50%) 

20 

£34 

0.125(13%) 

220 

3 

200 

0.5(50%) 

40 

£35 

0.125(13%) 

190 

4 

180 

0.5(50%) 

60 

L22 

0.25(25%) 

150 

5 

160 

0.5(50%) 

80 

L22 

0.25(25%) 

150 

6 

140 

0.5(50%) 

100 

L2\ 

0.375(38%) 

130 

7 

120 

0.5(50%) 

120 

L22,  L32 

0.375(38%) 

110 

8 

100 

0.5(50%) 

140 

L21,  £35 

0.5(50%) 

80 

9 

80 

0.5(50%) 

160 

-^21)  £35 

0.5(50%) 

80 

10 

60 

0.7(70%) 

180 

L211  L22 

0.625(63%) 

40 

11 

40 

0.9(90%) 

200 

Lu 

0.875(88%) 

20 

12 

20 

0.9(90%) 

220 

Lu 

0.875(88%) 

20 

optimal  abstraction  model.  The  optimal  abstraction  model  is  composed  by  observing 
the  partial  temporal  orderings  of  the  selected  methods.  For  the  determined  sequence 
of  the  methods,  the  composer  assigns  start  time,  s,-,  and  finish  time,  fi,  to  each  of 
the  methods.  By  determining  Sj  and  fi  for  each  method,  the  optimal  schedule  is 
determined. 

For  a  given  AT  in  Figure  4.4,  the  execution  sequence  of  the  methods,  O  : 

0=    (iVM,iVii2,...,iVi>fc_i,JVijfc) 
Then,  Sj  and  fi  for  each  method  in  O  is  determined  by  : 


(Si,l,/j,l)      =      (50,50  +  ^(^,0) 
(Si,2,/i,2)      =      (fi,l,Si,2+t(Nil2)) 
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Figure  4.4.  Scheduling  example  :  ^Vj_i,i  is  executed  by  iV,^,  7Vj>2,  ...,Nitf. 

(Si,Jfc_l, /i,fc-l)      =      {fi,k-2,Si,k-l  +t(Nitk-i)) 

{si,k,fi,k)    =    {fi,k-i,Si,k  +  t(Nijk)) 

where  t(Nij)  denotes  the  duration  of  the  corresponding  method  Nij  which  has  been 
assessed  through  the  discussions  in  Section  4.1,  and  so  is  the  start  execution  time  of 
the  given  AT. 

Consider  the  optimal  abstraction  level  which  is  shown  in  Figure  4.3.  The  optimal 
model,  O,  is  composed  of  : 

0=    (A2i,A3i,M35) 

Suppose  D(Mjj)  and  D(Aij)  are  properly  assessed.    For  a  starting  time  Sq,  the 
scheduling  of  the  optimal  model,  O,  is  determined  by  : 


S        —    ((S^21i/a2i).(SA34>/a34)>(SM35)/m35)) 


where 


sA2i  =  s0>  JA2\  =  SA2\  +  tAn 
SA34  =  3  A2\  i  JA34  =  SA34  +  M34 
sMm  =       J  A2\ 1     JM35  =       ^M35    1    ''Mas 

The  resulting  scheduling  diagram  is  shown  in  Figure  4.5. 
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Figure  4.5.  Optimal  model  composition  and  resulting  scheduling  diagram 

4.6     Summary 

Most  CASE  tools  are  useful  for  analyzing  the  logical  requirements  given  to  the 
system,  for  instance,  debugging  codes  and  well-defined  specifications  to  capture  the 
knowledge  about  the  system.  However,  most  CASE  tools  fail  to  analyze  the  schedu- 
lability  of  the  system.  In  this  chapter,  we  discussed  how  to  analyze  the  schedulability 
issue  of  the  system  and  guarantee  the  model's  timeliness  at  design  time.  We  handle 
the  timeliness  issue  by  determining  the  optimal  abstraction  level  to  simulate  the  sys- 
tem for  a  given  amount  of  time.  By  finding  the  places  where  behavioral  abstraction 
methods  are  to  be  used,  we  discard  unnecessary  structural  information  that  can  not 
be  simulated  within  a  given  amount  of  time.  The  resulting  abstraction  level  is  optimal 
in  the  sense  that  the  determined  level  guarantees  to  deliver  simulation  results  by  the 
deadline  and  also  has  the  maximum  accuracy  among  possible  combinations. 

We  illustrated  two  phases  for  the  problem  statement:  (1)  Constructing  AT  struc- 
ture to  organize  the  methods  of  the  base  model  in  a  way  to  facilitate  the  selection 
process  and  assessing  runtime/quality  for  each  method,  and  (2)  Applying  the  selection 
algorithms  to  determine  the  optimal  abstraction  level  of  the  base  model.  Quality  is 
assessed  by  (1)  degree  of  abstraction,  (2)  degree  of  interest  loss,  and  (3)  precision  loss 
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to  reflect  the  simulation  objective.  The  quality  of  each  node  in  AT  is  determined  ac- 
cording to  AND/OR  relationship  and  the  node  type  (A,  I,  M).  The  duration  of  each 
node  in  AT  is  assessed  by  the  method  type  (FBM,  FSM,  RBM,  EQM,  CODE),  and 
the  node  type.  Based  on  the  constructed  AT,  we  proposed  two  possible  approaches 
to  select  the  optimal  abstraction  level.  In  Section  4.3,  we  mapped  the  selection  prob- 
lem to  Operations  Research  and  proposed  two  IP-based  solutions.  IP-based  solutions 
provided  a  mathematical  foundation  for  the  selection  problem.  Search-based  solution 
in  Section  4.4  minimized  the  number  of  behavioral  abstraction  methods  to  be  used 
for  the  real-time  simulation,  while  delivering  simulation  results  by  the  given  dead- 
line. By  minimizing  the  number  of  behavioral  abstraction  methods,  the  determined 
abstraction  level  is  expected  to  achieve  the  minimum  quality  loss.  We  showed  some 
selection  results  from  the  proposed  approaches.  The  optimal  abstraction  model  is  the 
model  that  simulates  the  system  at  the  optimal  abstraction  level.  We  showed  how 
to  compose  the  optimal  abstraction  model  from  the  determined  abstraction  level.  A 
scheduling  process  is  done  to  assign  a  start  time  and  a  finish  time  for  each  of  the 
methods  that  comprise  the  optimal  abstraction  model.  By  determining  the  sched- 
ule of  the  optimal  model,  we  illustrate  how  the  resulting  model  delivered  simulation 
results  by  the  given  deadline. 

In  Chapter  5,  we  will  illustrate  OOPM/RT  methodology  though  an  example,  from 
the  model  generation  phase  to  the  optimal  model  selection  phase. 


CHAPTER  5 
FULTON  EXAMPLE  :  A  STEAMSHIP  MODELING 


Consider  a  steam-powered  propulsion  ship  model  named  FULTON  shown  in  Fig- 
ure 5.1.  In  FULTON,  the  furnace  heats  water  in  a  boiler:  when  the  fuel  valve  is 
OPEN,  fuel  flows  and  the  furnace  heats;  when  the  fuel  valve  is  CLOSED,  no  fuel 
flows  and  the  furnace  remains  at  ambient  temperature.  Heat  from  the  furnace  is 
added  to  the  water  to  form  high-pressure  steam.  The  high-pressure  steam  enters 
the  turbine  and  performs  work  by  expanding  against  the  turbine  blades.  After  the 
high-pressure  steam  is  exhausted  in  the  turbine,  it  enters  the  condenser  and  is  con- 
densed again  into  liquid  by  circulating  sea  water  [67,  68].  At  that  point,  the  water 
can  be  pumped  back  to  the  boiler.  Figure  5.1  shows  a  high-level  view  of  the  FULTON 
example. 

5.1     Model  Generation 

A  conceptual  model  is  constructed  on  OOPM.  It  is  designed  in  terms  of  classes, 
attributes,  methods  and  relationships  between  classes  (inheritance  and  composition) . 
Figure  5.2  shows  the  class  hierarchy  of  FULTON,  which  basically  follows  the  physical 
composition  of  a  steamship.  Classes  are  connected  by  a  composition  relationship  as 
denoted  by  rectangular  boxes  in  Figure  5.2.  V  denoted  in  the  white  box  specifies  1 
for  the  cardinality  of  the  associated  class. 

In  Figure  5.2,  class  Ship  has  a  Boiler,  a  Turbine,  a  Condenser  and  a  Pump.  Class 
Boiler  has  a  Pot  and  a  Knob.  Each  class  has  attributes  and  methods  to  specify  its 
dynamic  behaviors. 


72 


73 


TURBINE 


BOILER  ASSEMBLY 


BOILEI 


JJ U U LL 


FURNACE 


VJ 


Fuel  Valve 


PUMP 


_J 
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Figure  5.1.  High-level  view  of  a  shipboard  steam-powered  propulsion  plant,  FULTON 

5.1.1     Structural  Abstraction  of  FULTON 

Figures  5.3,  5.4  and  5.5  show  structural  abstractions  of  FULTON.  Since  FULTON 
can  be  configured  with  4  distinct  physical  components  and  a  functional  directionality 
between  them,  we  start  with  an  FBM.  The  FBM  is  located  in  class  Ship,  as  shown  in 
Figure  5.3.  Figure  5.3  has  4  blocks:  L\  for  modeling  the  functional  requirements  of  a 
boiler,  L2  for  turbine,  L%  for  condenser,  and  L\  for  pump.  Boiler  assembly  {L\)  has 
distinct  states  according  to  the  temperature  of  the  water.  L\  is  refined  into  : 

1.  B\  :  CODE  method  of  class  Knob,  which  provides  fuels  to  the  boiler 

2.  i?2  :   FSM,  M-j,  as  shown  in  Figure  5.4,  which  determines  the  temperature  of 
the  boiler  and  makes  state  transitions  according  to  the  temperature 

3.  B3  :  CODE  method  of  class  Boiler,  which  provides  high-pressure  steam 

Each  state  of  Figure  5.4  (Cold  (M13),  Heating  (M14),  Boiling  (M15),  and  Cool- 
ing (M16))  is  refined  into  an  algebraic  equation,  which  calculates  the  temperature 
based  on  the  position  of  the  knob  (Open,  Closed). 
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Figure  5.2.  Conceptual  model  of  FULTON:  FULTON  is  modeled  within  OOPM.  Con- 
ceptual model  is  designed  in  terms  of  classes,  attributes,  methods  (dynamic  method 
and  static  method)  and  relationships  of  classes  (inheritance  and  composition) 
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Figure  5.3.  Top  level  :  structural  abstraction  for  FULTON 


L2  is  refined  into  two  functional  blocks:  M9  and  M10.  M9  gets  the  high-pressure 
steam  from  the  boiler.  M10  is  decomposed  into  two  temporal  phases  as  shown  in  Fig- 
ure 5.5:  Exhausting  (M17)  and  Waiting  (M18).  If  there  is  no  steam  to  exhaust,  M10 
resides  in  the  waiting  state.  Otherwise,  M10  exhausts  steam  to  generate  the  work  of 
the  steamship.  L3  is  also  refined  into  two  functional  blocks:  Mil  and  M12.  Mil 
gets  the  exhausted  steam  from  the  turbine.  M12  has  two  distinct  temporal  phases: 
Condensing  (M19)  and  Cooldown  (M20),  in  Figure  5.5.    Condenser  decreases  the 
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Figure  5.4.  Structural  abstraction  of  Mi:  FSM  has  4  states  (Cold,  Cooling,  Heating 
and  Boiling) 

temperature  in  Cooldown  state,  waiting  for  the  turbine  to  send  more  steam.  Other- 
wise, M12  resides  in  Condensing  state  where  the  steam  from  the  turbine  turns  into 
liquid  again. 
5.1.2     Behavioral  Abstraction  of  FULTON 

We  start  with  the  observed  data  set  of  (input,  output)  from  the  simulation  of  the 
base  model.   With  this  prior  knowledge,  the  method  of  behavioral  abstraction  is  to 
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Figure  5.5.  Structural  abstraction  of  Mw  and  Mi2 
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Table  5.1.  New  multimodels  of  FULTON  with  behaviorally  abstracted  component(s): 
A  capital  letter  represents  a  full-resolution  model,  while  a  small  letter  represents  a 
low-resolution  model.  The  low  resolution  model  is  generated  through  behavioral 
abstraction 


no 

Model 

Abstracted 
Method 

Abstracted 
Component 

Ci 

BTCP 

N/A 

N/A 

c2 

BTcP 

M12 

Condenser 

c3 

BtCP 

Mio 

Turbine 

ct 

BtcP 

Mio,  M12 

Turbine,  Condenser 

c5 

bTCP 

M7 

Boiler 

c6 

bTcP 

M7,  Mi  2 

Boiler,  Condenser 

c7 

btCP 

M7,  Mio, 

Boiler,  Turbine 

ca 

btcP 

Mr,  Mio,  Mi 2 

Boiler,  Turbine,  Condenser 

generate  a  C++  procedure  that  codes  input/output  functional  relationship  using  a 
neural  network  model  (ADALINE,  Backpropagation)  or  a  Box-Jenkins  ARMA  model. 

We  abstract  the  multimodel  method  of  M7,  Mw  and  Mi2  with  the  Box- Jenkins 
model.  Given  three  behavioral  abstraction  methods  for  Mr,Mw  and  M12,  8  (23) 
new  models  can  be  generated  with  different  degrees  of  abstraction.  Table.  5.1  shows 
the  possible  combinations  of  the  behavioral  abstraction  methods.  The  upper  and 
lower  case  letters  in  each  model  name  indicate  the  level  of  detail  of  the  corresponding 
component.  A  capital  letter  indicates  that  the  model  incorporates  the  high  resolution 
version;  a  lower  case  letter  indicates  that  the  model  incorporates  the  low  resolution 
version.  For  example,  Ce  uses  two  behavioral  abstraction  methods  for  Mr  and  Mu- 
Therefore,  the  structural  information  associated  with  Mr  and  Mio  methods,  which 
are  both  FSMs,  are  abstracted. 

When  modelers  create  a  behavioral  abstraction  method,  they  pick  the  dynamic 
function  to  abstract;  then,  the  learning  process  begins.  Figure  5.6  shows  the  Box- 
Jenkins  abstraction  process  for  M7.  Based  on  the  learning  parameters  of  the  Box- 
Jenkins  model,  we  learn  the  input/output  functional  relationship  of  M7.   Once  the 
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performance  of  the  Box-Jenkins  model  is  accurate  enough,  we  generate  a  behavioral 
abstraction  method  based  on  the  resulting  weight  and  offset  vector.  One  important 
observation  is  that  the  execution  time  of  any  behavioral  abstraction  method  is  pre- 
dictable. The  contents  associated  with  it  represent  an  algebraic-based  routine  that 
calculates  an  output  based  on  the  output  calculation  algorithm  of  the  Box-Jenkins 
model.  As  long  as  the  output  calculation  algorithm  is  the  same,  the  execution  time 
of  the  behavioral  abstraction  method  differs  only  by  the  size  of  the  weight  and  bias 
vectors.  The  RMS  error  is  produced  after  the  learning  process  to  help  a  modeler 
assess  the  precision  loss  of  the  Box-Jenkins  behavioral  abstraction  method. 
5.2     Assessment  of  Execution  Time  and  Precision 

The  model  sets  in  Table  5.1  provide  alternatives  that  vary  in  the  degree  of  ab- 
straction; it  thus  allows  us  to  investigate  the  effects  of  the  model  structure  on  model 
accuracy  and  on  computation  time.  We  measured  the  execution  time  of  each  model 
by  varying  the  simulation  logical  clock  from  50  to  500  using  a  time  step  of  50.  As 
shown  in  Figure  5.7,  the  most  detailed  model,  C%,  takes  the  longest  time,  and  the 
least  detailed  model,  C%,  runs  faster  than  the  other  models.  The  output  of  each  model 
is  compared  to  the  most  detailed  model,  BTCP,  and  the  relative  precision  loss  to 
the  most  detailed  model,  BTCP,  is  measured  by  sum  of  the  squared  error  through 
testing  process.  Input  signals  different  from  the  training  signals  are  used  for  the  test- 
ing process,  and  the  precision  loss  is  cumulated  as  we  increase  the  simulation  logical 
clock  from  50  to  500  using  a  time  step  of  50.  For  the  least  detailed  model,  C8,  has 
the  maximum  accuracy  loss,  while  C2  shows  the  minimum  accuracy  loss  over  time. 

Figure  5.8  and  Figure  5.9  show  the  speed  up  and  accuracy  loss  according  to  the 
structure  of  each  model,  when  the  simulation  logical  clock  time  is  500.  Speedup  and 
precision  loss  is  measured  relative  to  the  most  detailed  model.  btcP  has  least  detailed 
structural  information  among  other  models  and  takes  the  least  time  to  simulate  the 
system. 
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Figure  5.6.  Behavioral  abstraction  :  A  modeler  selects  a  dynamic  function  to  ab- 
stract, Pot::Heatpot,  which  is  an  FSM.  States  and  their  transitions  will  be  lost,  but 
behavioral  information  will  be  preserved  to  some  level  of  fidelity.  In  the  learning 
process,  a  modeler  gives  several  parameters,  for  example,  lag  for  input  and  output 
signals 

5.3     Construction  of  the  Abstraction  Tree 


Figure  5.10  summarizes  the  structural  abstraction  of  the  FULTON.  The  resulting 
hierarchical  structure  becomes  the  base  model  which  simulates  the  FULTON  at  the 
most  detailed  level.  Each  method  is  connected  to  other  methods  through  refinement 
relationships. 

By  applying  the  behavioral  abstraction  technique  to  three  methods  (M7,  M10, 
M12),  and  producing  (A7,  A10,  A12),  respectively,  we  generate  the  AT  as  shown  in 


79 


Red  Ime  measurement  of  muHimodels 


Snutaion  Time 


4.5 

4 

x  10* 

Accuracy  loss  of  multimodals  with  abstractor) 

^s*^ 

„^     <£- ' 

3.5 

jT     _  x- 

3 

S?s 

. 

Jt^"'                                                       »-•*' 

>• 

^^^*"                                         „cr                     C4    : 

ea 

^"'  "                                             --**                       x 

3     2 
< 

1.5 

.  -  -8-  '  '  * 

1  rr.  ' 

o   - 

.     _  _  +  -  -  ' 

05 

...+-—>■—.■-.?:•"•'"*■      °        °    C2! 

X^_ 

-»"".?       ?       ?       t       t       r       t    ci 

Simulation  Time 


(a)  Execution  time  of  multimodels 
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Figure  5.7.  Execution  time/  accuracy  loss  of  models:  Behavioral  abstraction  yields 
shorter  elapsed  times.  As  we  increase  the  level  of  abstraction  by  using  more  behavioral 
abstraction  methods,  the  model  execution  time  decreases.  Accuracy  is  lost  as  we 
increase  the  number  of  behavioral  abstraction  methods  in  the  base  model 


□  Speedup 


Figure  5.8.  Speedup  for  the  set  of  fulton  models  relative  to  the  most  detailed  model, 
BTCP  for  a  simulation  time  of  500.  Execution  times  are  reported  by  clock(),  running 
on  WindowsNT,  x86  Family,  Intel  133  MHZ 
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Figure  5.9.   Accuracy  loss  for  the  set  of  fulton  models  relative  to  the  most  detailed 
model,  BTCP,  for  a  simulation  time  of  500 


Figure  5.11.  U  node  is  positioned  where  the  two  associated  different  resolution  meth- 
ods reside.  Intermediate  nodes  Ii  are  connected  to  the  children  by  an  OR  relationship 
as  discussed  in  Chapter  4. 

The  execution  time  and  accuracy  loss  of  internal  nodes  are  determined  by  recur- 
sively applying  the  cost/quality  assessment  equations  discussed  in  Chapter  4.  Many 
studies  have  been  done  to  estimate  the  execution  time  of  program  codes  before  ac- 
tually running  to  real-time  applications.  Most  of  the  methods  analyze  the  program 
structure  and  assign  different  time  scales  according  to  the  type  of  program  state- 
ments [69].  Our  focus  does  not  lie  in  proposing  a  new  process  for  assessing  the 
execution  time  of  a  method.  Instead,  we  use  available  methods  to  assess  the  execu- 
tion time  for  each  of  least  methods  in  the  AT.  We  assume  that  each  leaf  method  of 
AT  (M6,  MIS,  M14,M15,M16,M8,M9,M17,M18,  Mil,  M19,  M20,  M5)  is  applied 
to  a  time  estimation  method  and  (2,2,8,4,6,2,2,4,3,2,2,4,2)  is  assessed,  respectively, 
as  for  the  execution  time  for  each  of  the  methods.  Also,  the  execution  time  of  (A7, 
A10,  A12)  is  assumed  to  (4,  2,  2),  respectively.  Then,  non-leaf  nodes  iteratively  look 
for  child's  execution  time  and  calculate  its  own  execution  time  by  applying  the  time 
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Figure  5.10.  Abstraction  hierarchy  of  FULTON  example 
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Figure  5.11.  Abstraction  tree  for  the  FULTON  example  :  AT  has  AND/OR  nodes. 
When  there's  a  behavioral  abstraction  method,  OR  nodes  exist  in  order  to  specify 
either  one  of  the  method  is  executed  for  a  simulation 


assessment  equations  discussed  in  Chapter  4.  System  factor,  8  is  assumed  to  be  0; 
therefore  the  target  platform  in  which  the  model  will  be  executed  is  the  same  one  in 
which  the  model  execution  time  is  measured.  By  iteratively  applying  this  procedure, 
the  root  node  has  26  for  the  execution  time.  We  assume  that  there  is  no  special 
interesting  class  for  the  simulation;  thus,  a  modeler  would  look  at  every  class  equally. 
We  also  assume  that  the  precision  loss  of  each  behavioral  abstraction  method  is  as- 
sessed properly.  Currently,  we  assess  the  precision  loss  of  each  behavioral  abstraction 
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method  manually,  through  the  hold-out  technique  discussed  in  Chapter  4;  the  assess- 
ment process  usually  involves  exhaustive  testing  of  the  methods.  For  the  simplicity  of 
illustration,  we  assume  that  the  precision  loss  of  (A7,  AIO,  A12)  is  properly  assessed 
to  (0.4,  0.2,  0.3).  Then,  the  quality  loss  of  each  method,  07,  aio  and  a^  is  defined 
by  0.325,0.125  and  0.175  respectively,  according  to  quality  loss  equation  discussed 
in  Chapter  4.  In  this  case,  the  simulation  objective  takes  the  form  of  :  "Given  a 
deadline  of  d,  simulate  FULTON  with  no  special  interest  in  any  of  Boiler,  Turbine, 
Condenser  and  Pump  classes.  Try  to  minimize  the  overall  quality  loss,  and  simulate 
FULTON  model  at  the  lowest  abstraction  level,  provided  that  the  given  deadline  d  is 
not  violated. 

5.4     Selection  of  the  Optimal  Abstraction  Model 

The  base  model  of  FULTON  takes  26  units  to  complete  the  simulation.  Suppose 
we  have  20  units  for  a  deadline.  Upon  receiving  the  time  constraint,  we  immediately 
know  that  the  behavioral  abstraction  is  needed  to  make  the  simulation  faster.  The 
optimal  abstraction  level  is  determined  by  the  algorithm  discussed  in  Section  4.4  and 
IP-based  approaches,  IP  I  and  IP2),  discussed  in  Section  4.3. 

For  a  given  AT  in  Figure  5.11,  the  objective  function  of  IP1  is  defined  as: 

Minimize  (I7  +  Iw  +  I12)  (5.1) 

subject  to 


c 


a7I7  +  aiolio  +  anln  <    a, 

t-jl-j  +  £ioiio  +  ^12-^12  >     t 

a7  =  0.375,  aw  =  0.125,  a12  =  0.175 
£7  =  4,  £10  =  2,ti2  —  2 


(5.2) 
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Then,  the  selection  of  the  optimal  abstraction  level  solves  the  objective  function 
defined  in  equation  5.1  with  the  constraints  defined  by  equation  5.2. 
The  objective  function  of  IP2  is  defined  as  : 

Minimize  (I7  *  a7  +  I\o  *  aw  +  I\2  *  012)  (5.3) 

subject  to 

t7I7  +  £10/10  +  ^12^12  >     tc 

a7  =  0.375,  aio  =  0.125,ai2  =  0.175 
h  =  4,£io  =  2,  t\2  =  2 


(5.4) 


Then,  the  selection  of  the  optimal  abstraction  level  solves  the  objective  function 
defined  in  equation  5.3  with  the  constraints  defined  by  equation  5.4.  Since  the  desired 
speedup  to  be  achieved  for  a  given  deadline  is  26  —  20  =  6,  we  assign  6  to  tc.  To 
find  out  the  most  accurate  combination,  we  assign  1.0  to  ac.  The  accuracy  is  not 
constrained  to  a  certain  bound;  rather  the  algorithm  has  the  freedom  to  find  the 
most  accurate  combination. 

The  search-based  algorithm  increases  the  number  of  behavioral  abstraction  meth- 
ods to  be  used  for  the  deadline.  The  algorithm  examines  whether  one  behavioral 
abstraction  method  will  resolve  the  time  constraint.  Neither  of  the  candidates  meets 
the  deadline.  Therefore,  the  algorithm  increases  the  number  of  behavioral  abstrac- 
tion methods  to  use  for  the  simulation.  When  two  behavioral  abstraction  methods 
are  used,  the  fastest  behavioral  abstraction  A7  achieves  the  deadline  if  either  of  ^4io 
or  A\2  is  combined  with  A7.  Therefore,  the  algorithm  concludes  that  using  2  behav- 
ioral abstraction  methods  will  resolve  the  timeliness  requirement.  At  this  point,  the 
algorithm  begins  to  find  the  most  accurate  combination.  Possible  combinations  are 
{At,  Aio),  (^7,  ^12)  and  (Aw,  Ai2)-   The  most  accurate  combination  is  (Ai0,Ai2); 
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Figure  5.12.  Optimal  abstraction  degree  for  a  deadline  of  20 
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Figure  5.13.  Scheduling  diagram  for  a  deadline  of  20 

however  it  can  not  achieve  the  timeliness  requirement.  The  next  accurate  combi- 
nation, which  is  (A7,  Aio),  achieves  the  timeliness  requirement.  So,  the  algorithm 
declares  {A7,  Aio)  as  the  optimal  abstraction  degree  for  a  given  AT  and  a  deadline  of 
20.  Figure  5.12  shows  the  optimal  abstraction  level  of  the  given  AT.  The  execution 
of  I7  is  made  by  A7,  as  I\o  by  Aw,  and  as  Iu  by  M12.  Then,  the  optimal  abstraction 
model  is  composed  of  the  sequence  (M6,  A7,  M8,  M9,ylio,  Mn,  Mi2,  M5).  Note  that 
FSM  models  of  Boiler  and  Turbine  classes  have  been  cut  off  to  save  simulation  time. 
The  corresponding  scheduling  diagram  is  shown  in  Figure  5.13. 

Table  5.2  shows  other  selection  examples.   The  IP2  method  produces  a  different 
answer  for  a  deadline  of  22.    The  IP1  and  the  search-based  methods  minimize  the 
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Table  5.2.  Selection  examples  of  three  algorithms  for  FULTON 


deadline 

20 

22 

24 

IP1 

hi  ho 

h 

ho 

IP2 

hi  ho 

AO)   I\2 

ho 

Search 

hi  ho 

h 

ho 

number  of  behavioral  abstraction  methods  during  the  selection  in  order  to  minimize 
the  loss  of  structural  information.  When  modelers  want  to  minimize  the  loss  of 
structural  information  and  preserve  the  base  model  structure  as  much  as  possible,  the 
optimal  abstraction  occurs  at  h-  However,  if  the  simulation  objective  is  to  minimize 
the  expected  quality  loss,  we  apply  behavioral  abstraction  methods  at  ho  and  712,  as 
suggested  from  IP2. 

5.5     Summary 

In  this  Chapter,  we  illustrated  the  OOPM/RT  methodology  with  an  actual  ex- 
ample, FULTON.  FULTON  has  four  distinct  physical  units,  which  are  connected 
in  a  directed  order.  FBM  is  a  natural  representation  frame  to  model  functional 
relationships  between  four  distinct  components.  Therefore,  we  start  the  structural 
abstraction  process  with  a  simple  four-block  FBM.  Each  of  the  four  blocks  is  refined 
into  another  model  type,  FSM,  since  the  functional  aspects  associated  with  each  of 
the  four  blocks  can  be  viewed  with  states  and  the  transitions  between  the  states. 
Multimodeling  methodology  provides  a  mechanism  to  group  all  heterogeneous  model 
types  together  under  one  hierarchical  structure.  By  allowing  different  model  types  to 
capture  the  system,  modelers  better  capture  the  functional  requirements  given  to  the 
system.  The  structural  abstraction  process  constructs  a  base  model  that  simulates 
the  system  at  the  highest  detail.  Behavioral  abstraction  process  is  applied  to  the  base 
model  by  abstracting  any  level  with  a  generic  Box- Jenkins  model.  We  showed  how 
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execution  time  of  the  base  model  could  be  reduced  by  using  behavioral  abstraction 
methods. 

When  the  base  model  cannot  simulate  the  system  by  a  given  deadline,  the  level 
of  abstraction  is  controlled  to  deliver  simulation  results  by  the  given  deadline.  Three 
algorithms  were  applied  to  find  the  optimal  abstraction  level  of  the  base  model  by 
considering  both  timing  constraints  and  quality  loss.  The  optimal  abstraction  model 
is  determined  by  either  1)  minimizing  the  number  of  behavioral  abstraction  methods 
to  be  used  for  real-time  simulations,  2)  minimizing  quality  loss  of  the  base  model,  or 
3)  minimizing  the  number  of  behavioral  abstraction  methods  and  quality  loss  for  real- 
time simulations,  all  of  which  must  be  achieved  while  still  satisfying  a  given  timing 
constraint. 


CHAPTER  6 
APPLESNAIL  EXAMPLE  :  A  POPULATION  MODEL  OF  APPLE  SNAILS 

The  Across  Trophic  Level  System  Simulation  (ATLSS)  is  a  set  of  ecological  mod- 
els designed  to  evaluate  the  ecological  effects  of  different  water  management  plans  for 
the  Everglades  National  Park  (ENP)  and  Big  Cypress  National  Preserve  (BCNP). 
The  South  Florida  Everglades  are  characterized  by  complex  patterns  of  spatial  het- 
erogeneity and  temporal  variability;  water  flow  is  the  major  factor  controlling  the 
trophic  dynamics  of  the  system.  A  key  objective  of  modeling  studies  for  the  system 
is  to  compare  the  future  effects  of  alternative  hydrologic  scenarios  on  the  biotic  com- 
ponents of  the  system  [70].  The  goal  of  APPLESNAIL  is  to  predict  the  population 
levels  of  apple  snails  in  a  time- varying  temperature  of  the  hydrology.  Figure  6.1  shows 
the  overall  apple  snail  life  cycle  in  a  system  dynamics  flow  graph.  System  Dynam- 
ics (SD)  is  a  specific  methodology  for  engineering  simulation  models  when  a  system 
can  be  viewed  as  variables  (or  levels)  and  dependencies  between  the  variables  [15].  In 
Figure  6.1,  the  symbols  resemble  water  valves  are  examples  of  rates:  oviposition  rate, 
hatch  rate,  egg  loss  rate,  growth  rate,  death  rate,  maturation  rate,  and  senescence 
rate.  The  rectangles  are  examples  of  levels:  number  of  eggs,  number  of  juveniles, 
number  of  preadults,  number  of  reproadults,  and  number  of  postadults.  The  symbols 
of  the  system  dynamics  flow  graph  provide  us  with  a  hydraulic  (or  fluidic)  metaphor 
for  systems  problem  solving.  Water  represents  individual  entities  passing  through  the 
system  (in  this  case,  number  of  eggs,  number  of  juveniles  etc).  The  water  valve  (or 
rate)  can  be  adjusted  just  like  a  water  tap,  and  the  rectangles  can  be  seen  as  contain- 
ers (the  levels)  for  the  water  flow.  Other  symbols,  such  as  circles,  represent  auxiliary 
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Figure  6.1.  APPLESNAIL  life  cycle  model 

variables  for  determining  rates.  The  SD  flow  graph  is  translated  into  a  set  of  differen- 
tial equations  and  difference  equations  for  simulation  purposes.  Refer  to  reference  [15] 
for  the  general  algorithm  for  taking  a  system  dynamics  flow  graph  and  producing  a 
set  of  equations. 

6.1     Model  Generation 

A  conceptual  model  of  APPLESNAIL  is  constructed  on  OOPM.  It  is  designed 
in  terms  of  classes,  attributes,  methods  and  relationships  between  classes  using  in- 
heritance and  composition.  Figure  6.2  shows  the  class  hierarchy  of  APPLESNAIL, 
which  basically  follows  the  age  class  of  apple  snails:  Egg  (E),  Juvenile  (J),  Pread- 
ult  (P),  Reproadult  (R)  and  Postadult  (A).  Classes  are  connected  by  a  composition 
relationship  as  denoted  by  rectangular  boxes  in  Figure  6.2.  V  and  1,  denoted  in  the 
white  boxes,  specify  one  for  the  cardinality  of  the  associated  class.  In  Figure  6.2, 
class  Marsh  is  composed  of  8  by  12  Patch.  Each  Patch  has  one  SnailPop  and  one 
Hydrology.  SnailPop  is  composed  of  EggPop,  JuvPop,  PreadultPop,  ReproPop,  and 
PostPop,  each  of  which  determines  the  population  of  its  age  class.  In  the  following 
section,  we  discuss  attributes  and  methods  of  each  class  to  describe  the  dynamic 
behaviors  associated  with  the  life  cycle  of  apple  snails. 
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Figure  6.2.  Conceptual  model  of  APPLESNAIL 

6.1.1     Structural  Abstraction  of  APPLESNAIL 

Figures  6.3  -  6.9  show  the  structural  abstraction  of  APPLESNAIL.  The  starting 
method,  Mi,  is  located  in  the  Patch  class  as  shown  in  Figure  6.3.  Mi  reads  water  tem- 
perature from  the  Hydrology  class.  The  water  temperature  of  a  month  is  determined 
by: 

temperature  =  32  *  SINWAVE(l,  12) 

Based  on  the  water  temperature,  M2  calculates  the  population  for  each  age  class  of 
apple  snails.  M2  is  an  FBM  as  shown  in  Figure  6.4.  M2  specifies  how  the  popu- 
lation of  each  age  class  is  determined  based  on  the  causal  relationships  among  the 
APPLESNAIL  classes.  Af4  calculates  1)  the  population  of  the  egg  class,  and  2)  the 
hatch  rate  based  on  the  current  temperature  and  reproadult  population. 
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eggs(t)  =  eggs(t-dt)  +  (oviposition  -  hatch  rate  -  egg  loss  rate)*dt 

initial  condition:  eggs  =  0 

inflows:  oviposition  =  (reproadult*0.5)*120*mate  index  .      . 

outflows  : 
hatch  rate  =  eggs*hatch  fraction  /  incubation  time 
egg  loss  rate  =  eggs  *  (  1-  hatch  fraction)  /  incubation  time 

Figure  6.5  shows  an  SD  model  for  equation  6.1.  Each  symbol  of  M4  is  refined  into 
another  model  type;  For  instance,  Mu  is  a  RBM  which  determines  the  mate  index 
by  the  following  rule: 


IF  (temperature  >  20)  THEN  1  ELSE  0 

Other  symbols  are  refined  into  CODE  methods,  Mw,  Mu,  M13,  and  Mu  to  represent 
the  detailed  egg  behaviors  discussed  in  equation  6.1. 

M5  determines  1)  the  growth  rate  and  2)  the  population  of  the  juvenile  class, 
based  on  the  hatch  rate  from  M4. 


juv(t)  =  juv(t-dt)  +  (hatch  rate  -  growth  rate  -  juvenile  death  rate)  *  dt 

initial  condition:  juv  =  0 

inflows:  hatch  rate  =  eggs  *  hatch  fraction  /  incubation  time 

outflows  :  (6.2) 

growth  rate  =  juv  /  growth  time 

juvenile  death  rate  =  juv  *  0.4 


Rate  symbols  are  refined  into  CODE  methods,  Mi6,  Mi7,  and  Mi8,  to  represent  the 
behaviors  in  equation  6.2.  Figure  6.6  shows  the  SD  model  of  M5. 

The  growth  rate  is  sent  to  M6  and  used  to  calculate  1)  the  population  of  the 
preadult  class,  and  2)  the  maturation  rate  of  the  preadult  class. 
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preadult(t)  =  preadult(t-dt)  + 

(growth  rate  -  maturation  rate  -  preadult  death  rate)  *  dt 
initial  condition:  preadult  =  0 

inflows:  growth  rate  =  juv  /  growth  time  .      . 

outflows  : 

maturation  rate  =  preadult  /  maturation  time 

preadult  death  rate  =  preadult  *  0.2 


Rate  symbols  are  refined  into  CODE  methods  to  describe  the  detailed  behaviors  in 
equation  6.3:  M20  defines  the  growth  rate,  M^\  defines  the  preadult  death  rate,  and 
M22  defines  the  maturation  rate.  Figure  6.7  shows  the  SD  model  of  Me. 

Mj  receives  the  maturation  rate  from  M5  and  calculates  1)  the  senescence  rate, 
and  2)  the  population  of  the  reproadult  class. 


reproadult(t)  =  reproadult(t  —  dt)  + 

(maturate  rate  -  senescence  rate  -  reproadult  death  rate)  *  dt 

initial  condition:  reproadult  =  1000 

inflow:  maturation  rate  =  preadult  /  maturation  time  ,„  ... 

,,,  '  (6.4) 

out  J  low  : 

senescence  rate  =  reproadult  /  senescence  time 

reproadult  death  rate  =  reproadult  *  0.2 


Rate  symbols  are  refined  into  CODE  methods  to  describe  the  detailed  behaviors  in 
equation  6.4:  M24  defines  maturation  rate,  M25  defines  reproadult  death  rate,  and  M2e 
defines  senescence  rate.  Figure  6.8  shows  the  SD  model  of  My. 

The  determined  senescence  rate  goes  to  M8,  where  the  senescence  rate  is  used  to 
calculate  the  population  of  postadults.  Each  population  information  is  collected  in 
Ms  to  be  reported  on  OOPM. 


postadult(t)  =  postadult[t  —  dt)  +  (senescence  rate  -  postadult  death  rate)  *  dt 
initial  condition:  postadult  =  0  (atc\ 

inflows:  senescence  rate  =  reproadult  /  senescence  time 
outflows:  postadult  death  rate  =  postadult  *  0.9 
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Figure  6.3.  Top  level  FBM,  Mx:  starting  method 

Rate  symbols  are  refined  into  CODE  methods  to  describe  the  detailed  behaviors  in 
equation  6.5:  M2s  defines  the  senescence  rate,  and  M29  defines  the  postadult  death 
rate.  Figure  6.9  shows  the  SD  model  of  Mg. 

6.1.2     Behavioral  Abstraction  of  APPLESNAIL 

The  process  of  the  behavioral  abstraction  starts  with  the  observed  data  set  of 
(input, output)  from  the  simulation  of  the  base  model.  Simulation  (input,output) 
data  are  collected  for  a  simulation  logical  clock  of  100  with  a  time  step  of  0.1.  With 
this  prior  knowledge,  we  abstract  the  multimodel  methods  of  M4,  M5,  M6,  M7,  and 
M8  with  the  Box- Jenkins  models. 

Figure  6.10  shows  the  behavioral  abstraction  process  of  M5.  Inputs  for  the  Box- 
Jenkins  model  are  1)  water  temperature,  and  2)  reproadult  population.  Based  on 
the  learning  parameters  specified  in  the  parameter  window,  the  Box-Jenkins  learning 
algorithm  reads  the  input  and  output  data  and  produces  weights  and  offsets  that 
explain  the  input/output  functional  relationship.  Though  the  output  from  the  Box- 
Jenkins  model  cannot  exactly  follow  the  trajectory  of  the  original  growth  rate,  the 
overall  behaviors  are  well-learned  and  predicted.  (A4,  A5,  A6,  A-j,  A6)  are  generated 
from  the  behavioral  abstraction  process  of  (M4,  M5,  M6,  M7,  M8).  We  double  the 
simulation  time  and  obtain  the  prediction  performance  for  each  of  the  behavioral 
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Figure  6.4.  Structural  abstraction  of  M3:  M3  describes  how  the  population  level  is 
determined  for  each  age  class  of  apple  snails.  Each  block  of  M3  is  refined  into  an  SD 
model 
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Figure  6.5.    Structural  abstraction  of  M4:    M4  defines  the  egg  population  in  a  SD 
model 
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Figure  6.6.  Structural  abstraction  of  M5:  M5  defines  the  juvenile  population  in  a  SD 
model 
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Figure  6.7.  Structural  abstraction  of  M6:  M6  defines  the  preadult  population  in  a  SD 
model 
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Figure  6.8.  Structural  abstraction  of  M7:  M7  defines  the  reproadult  population  in  a 
SD  model 


Figure  6.9.   Structural  abstraction  of  M8:  M8  defines  the  postadult  population  in  a 
SD  model 
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Figure  6.10.  Behavioral  abstraction  process  of  M5 

abstraction  methods,  Ai,  A5,  A6,  A-?,  and  A8.  The  prediction  results  are  plotted  in 
Figures  6.11  -  6.15. 

6.2     Assessment  of  Execution  Time  and  Precision 

The  model  sets  in  Table  6.1  provide  alternatives  that  vary  in  the  expected  accuracy 
and  in  the  computation  time.  The  upper-  and  lower-case  letters  in  each  model  name 
indicate  the  level  of  detail  of  the  corresponding  apple  snail  class.  Table  6.1  allows  us  to 
investigate  the  effects  of  the  model  structure  on  model  accuracy  and  on  computation 
time.  We  measured  the  execution  time  of  each  model  for  a  simulation  logical  clock  of 
200  with  a  time  step  of  0.1.  The  most  detailed  model,  C\  takes  the  longest  time,  and 
the  least  detailed  model,  C&,  runs  faster  than  the  other  models.  The  output  of  each 
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(a)  hatch  rate  prediction 


(b)  egg  population  prediction 


Figure  6.11.  Prediction  of  hatch  rate  and  egg  population 

model  is  compared  to  the  most  detailed  model,  C\,  and  the  relative  precision  loss  to 
the  most  detailed  model,  C\,  is  measured  by  the  sum  of  the  squared  error.  The  least 
detailed  model,  C&,  has  the  maximum  accuracy  loss,  while  C5  shows  the  minimum 
accuracy  loss  over  time. 

6.3     Construction  of  the  Abstraction  Tree 


Figure  6.16  summarizes  the  structural  abstraction  of  APPLESNAIL  in  an  abstrac- 
tion hierarchy.  The  abstraction  hierarchy,  in  Figure  6.16,  becomes  the  base  model 
that  simulates  APPLESNAIL  at  the  highest  detail.  Each  method  is  connected  to 
others  through  refinement  relationships. 

By  applying  the  behavioral  abstraction  technique  to  five  methods  (M4,  M5,  M6, 
M7,  M8)  and  producing  (A4,  A5,  A6,  A7,  A8),  respectively,  we  generate  an  AT  as 
shown  in  Figure  6.17.  Ii  node  is  positioned  where  the  two  associated  different  reso- 
lution methods  reside.  Intermediate  nodes  /,  are  connected  to  their  children  by  the 
OR  relationship,  as  discussed  in  Chapter  4. 

The  execution  time  and  quality  loss  of  each  node  are  determined  by  recursively 
applying  the  cost/quality  assessment  equations  discussed  in  Chapter  4.  We  assume 
that  each  leaf  method  of  the  AT  is  applied  to  a  time  estimation  method  available 
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(a)  growth  rate  prediction 


(b)  juvenile  population  prediction 


Figure  6.12.  Prediction  of  growth  rate  and  juvenile  population 


in  Real-Time  literature  and  assessed  to  a  value  as  shown  in  Figure  6.17.  Also,  the 
execution  time  of  the  behavioral  abstraction  methods  (A4,  A5,  Ae,  A7,  As)  are  as- 
sumed to  discuss  the  speedup  amount  in  Table  6.2.  Non-leaf  nodes  iteratively  look 
for  the  child's  execution  time  and  calculate  its  own  execution  time  by  applying  the 
time  assessment  equations  discussed  in  Chapter  4.  The  system  factor,  8,  is  assumed 
to  be  0,  as  in  the  case  of  FULTON;  therefore,  the  target  platform  in  which  the  model 
will  be  executed  is  the  same  one  in  which  the  model  execution  time  is  measured.  By 
iteratively  applying  this  procedure,  the  root  node  has  26589  CPU  cycles  for  the  exe- 
cution time.  We  assume  that  there  is  no  special  interesting  class  for  the  simulation; 
thus,  a  modeler  would  look  at  each  class  equally.  The  expected  precision  loss  of  each 
behavioral  abstraction  method  is  assessed  through  the  F-test  [71],  as  shown  in  Ta- 
ble 6.2.  The  simulation  objective  takes  the  form  of:  "Given  a  deadline  of  A,  simulate 
APPLESNAIL  with  no  special  interest  in  any  of  the  classes.  Try  to  minimize  the 
overall  quality  loss,  and  simulate  the  APPLESNAIL  model  at  the  most  detailed  level, 
provided  that  the  given  deadline  d  is  not  violated". 
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(a)  maturation  rate  prediction 


(b)  preadult  population  prediction 


Figure  6.13.  Prediction  of  maturation  rate  and  preadult  population 


6.4     Selection  of  the  Optimal  Abstraction  Model 


For  a  given  AT  as  in  Figure  6.17,  the  objective  function  of  IP1  is  defined  as 


Minimize  (74  +  75  +  76  +  h  +  h) 


(6.6) 


subject  to 


aJA  +  a5I5  4-  a6I6  +  a7I7  +  a8/8     <    ac 

Uh  +  tbh  +  Uh  +  t7I7  +  Uh       >    tc 

a4  =  0.59,  a5  =  0.55,  a6  =  0.43 
a7  =  0.48,  a8  =  0.07 


(6.7) 


U  =  592,  t5  =  100,  t6  =  19 
t7  =  31,  ts  =  22 

Then,  the  IP1  selection  of  the  optimal  abstraction  level  solves  the  objective  function 
defined  in  equation  6.6  with  the  constraints  denned  in  equation  6.7. 
The  objective  function  of  IP 2  is  defined  as  : 


Minimize  (04/4  +  a5/5  +  a6I6  +  a7I7  +  a8/8) 


(6.8) 
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(a)  senescence  rate  prediction 


(b)  reproadult  population  prediction 


Figure  6.14.  Prediction  of  senescence  rate  and  reproadult  population 


(a)  postadult  population  prediction 


(b)  prediction  error 


Figure  6.15.  Prediction  of  postadult  population  and  prediction  error 


subject  to 


£4/4  +  £5/5  +  t^Ie  +  t-jl-j  +  tgls       >    tc 

aA  =  0.59,  a5  =  0.55,  a6  =  0.43 
a7  =  0.48,  a8  =  0.07 

U  =  592,  tb  =  100,  £6  =  19 
t7  =  31,  £8  =  22 


(6.9) 


Then,  IP2  selection  of  the  optimal  abstraction  level  solves  the  objective  function 
defined  in  equation  6.8  with  the  constraints  defined  in  equation  6.9. 
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Table  6.1.  Execution  time  and  accuracy  loss  of  multimodels:  execution  time  when  the 
simulation  logical  clock  is  200  with  a  time  step  of  0.1.  Execution  time  is  measured 
by  clock()  on  Windows  NT,  x86  Family,  Intel  133  MHZ.  The  precision  loss  of  each 
model  is  measured  by  the  sum  of  the  squared  error  as  compared  to  C\.  E/e:  EggPop, 
J/j:  JuvPop,  P/p:  PreadultPop,  R/r.  ReproPop,  A/a:  PostPop 


EJPRA 

e.JPRA 

ejPRA 

ejpRA 

ejprA 

ejpra 

(Ci) 

(C2) 

(Cs) 

(C4) 

(Cb) 

(C6) 

Abstracted 

n/a 

M4 

A/4,M5 

M4,  M5 

Mi,  M5, 

M4,  MB,  M6, 

Method 

M6 

M6,  M7 

My,  M8 

CPU  cycle 

26589 

25997 

25897 

25878 

25847 

25825 

Speedup 

592 

692 

711 

742 

764 

Precision 

n/a 

5.0184e+ll 

5.6288e+ll 

5.6689e+ll 

5.6706e+ll 

5.6706e+ll 

loss 

Relative 

precision 

n/a 

1 

1.1216 

1.1296 

1.13 

1.13 

loss 

Table  6.2.  Speedup  and  accuracy  loss  of  the  behavioral  abstraction  method:  Speedup 
is  measured  by  the  savings  of  CPU  cycles  compared  to  the  base  model,  EJPRA  (Ci). 
The  expected  precision  loss  is  measured  by  an  F-test  using  the  original  output  from 
EJPRA  and  the  predicted  output  from  each  of  the  multimodels.  hrate:  hatch  rate, 
mrate  :  maturation  rate,  grate:  growth  rate,  srate:  senescence  rate 

A4  A5  A6  A7  A8 

Speedup      592  100  19  31  22 

Precision     hrate=  0.0425  grate  =  0.0144  mrate  =  0.2598  srate  =  0.1330  post  =  0.9535 

(F-test)        egg  =  0.0443  juvenile=  0.0160  preadult  =  0.2454  repro  =  0.1727 


The  base  model  of  APPLESNAIL  takes  26589  cpu  cycles  to  complete  the  simu- 
lation of  200  clocks  with  a  time  step  of  0.1.  Suppose  we  have  25939  CPU  cycles  for 
a  deadline.  Upon  receiving  the  time  constraint,  we  immediately  know  that  the  be- 
havioral abstraction  is  needed  to  make  the  simulation  faster.  The  desired  speedup  is 
26589  -  25939  =  650.  We  set  650  for  tc  of  IP  I  and  IP2.  To  find  out  the  most  accurate 
combination,  we  assign  5.0  to  ac  under  the  assumption  that  each  of  the  behavioral 
abstraction  methods  would  lose  accuracy  at  the  maximum  rate  of  1.0.  The  IP1  min- 
imizes the  use  of  behavioral  abstraction  methods  during  the  selection,  while  the  IP2 
minimizes  the  expected  quality  loss  during  the  selection.  The  search-based  algorithm 
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Figure  6.16.  Abstraction  hierarchy  of  APPLESNAIL  model 

increases  the  number  of  behavioral  abstraction  methods  to  be  used  for  the  deadline. 
The  algorithm  examines  whether  one  behavioral  abstraction  method  will  resolve  the 
time  constraint.  Clearly,  neither  of  the  candidates  meets  the  deadline.  Therefore,  the 
algorithm  increases  the  number  of  behavioral  abstraction  methods  to  use  for  the  sim- 
ulation. When  two  behavioral  abstraction  methods  are  used,  the  fastest  behavioral 
abstraction  AA  achieves  the  deadline,  if  one  of  (^45,  Ae,  At,  A8)  is  combined  with  A4. 
Therefore,  the  algorithm  concludes  that  using  two  behavioral  abstraction  methods 
will  resolve  the  timeliness  requirement.  At  this  point,  the  algorithm  begins  to  find 
the  most  accurate  combination  and  decides  on  an  (A4,  ^5)  combination. 

Figure  6.18  shows  the  determined  abstraction  degree  of  the  AT  for  a  given  deadline 
of  25939.  The  execution  of  I4  and  I5  are  made  by  the  low  resolution  methods,  (A4, 
A5),  respectively.  Other  intermediates  nodes  are  executed  by  the  high  resolution 
methods,  (M6,  M7,  M8). 

The  optimal  abstraction  model  is  composed  of  the  sequence  : 

(M2,  A},  A5,  M19,  M20,  M2i,  M22,  M23,  M24,  M25,  M26,  M27,  M28,  M29,  M9) 
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Figure  6.17.  Abstraction  tree  structure  of  APPLESNAIL  model 
Table  6.3.  Optimal  abstraction  degree  determined  from  the  three  selection  methods 


no 

1 

2 

3 

4 

5 

deadline 

26539 

26499 

28389 

25939 

25889 

(desired  speedup 

50 

90 

200 

650 

700) 

IP1 

h 

h 

h 

h,  h 

h,  h-,  h 

achieved  deadline 

26489 

26489 

25997 

25897 

25878 

quality  loss 

(0.55) 

(0.55) 

(0.59) 

(1.14) 

(1.59) 

IP2 

h,h 

h 

h 

h,h 

h,  h,  h 

achieved  deadline 

26536 

26489 

25997 

25897 

25875 

quality  loss 

(0.55) 

(0.55) 

(0.59) 

(1.14) 

(1.21) 

search 

h 

h 

h 

h,h 

h,  h,  h 

achieved  deadline 

26489 

26489 

25997 

25897 

25875 

quality  loss 

(0.55) 

(0.55) 

(0.59) 

(1.14) 

(1.21) 

Note  that  SD  models  of  EggPop  and  JuvPop  classes  are  discarded  to  save  simula- 
tion time.  The  corresponding  scheduling  diagram  is  shown  in  Figure  6.19. 

Table  6.3  shows  other  selection  examples.  The  IP2  method  produces  a  different 
answer  for  a  deadline  of  26539  and  25889.  The  IP1  and  the  search-based  methods 
minimize  the  number  of  the  behavioral  abstraction  methods  during  the  selection  to 
maximally  preserve  the  base  model's  structure,  while  the  IP2  minimizes  the  overall 
quality  loss,  as  in  the  case  1. 


26300-1592+ 1 00)  =  26300 
M3    2630(1 
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Figure  6.18.  Optimal  abstraction  degree  for  a  deadline  of  25939 


Figure  6.19.  Scheduling  diagram  for  a  deadline  of  25939 


6.5     Summary 
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In  this  Chapter,  we  illustrated  the  OOPM  methodology  with  an  actual  example, 
APPLESNAIL.  The  starting  method  is  an  FBM  that  accepts  the  hydrology  informa- 
tion from  the  Hydrology  class  and  sends  the  water  temperature  to  another  FBM  that 
calculates  the  population  of  each  age  class.  The  second  FBM  has  five  blocks,  each 
of  which  represents  five  age  classes  of  apple  snails.  The  five  blocks  are  connected  in 
a  directed  order  by  following  the  life  cycle  of  apple  snails.  Each  of  the  five  blocks  is 
refined  into  an  SD  method  that  describes  how  the  population  of  each  age  class  is  de- 
termined, based  on  the  inflow  and  outflow  associated  with  the  age  class.  The  symbols 
of  each  SD  model  are  refined  into  either  RBM  or  CODE  methods.  Multimodeling 
methodology  provides  a  mechanism  to  group  all  heterogeneous  model  types  together 
under  one  hierarchical  structure.    By  allowing  different  model  types  to  describe  the 
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system,  we  help  modelers  better  capture  the  functional  requirements  given  to  the  sys- 
tem. The  structural  abstraction  process  constructs  a  base  model  that  simulates  the 
system  at  the  highest  detail.  The  behavioral  abstraction  process  is  applied  to  the  base 
model  by  abstracting  any  level  with  a  generic  Box-Jenkins  model.  We  showed  how  the 
execution  time  of  the  base  model  could  be  reduced  by  using  behavioral  abstraction 
methods. 

When  the  base  model  cannot  simulate  the  system  by  a  given  deadline,  the  level  of 
abstraction  is  controlled  to  deliver  simulation  results  in  a  timely  fashion.  Three  algo- 
rithms were  applied  to  find  the  optimal  abstraction  level  of  the  base  model  by  consid- 
ering both  timing  constraints  and  the  expected  quality  loss.  The  optimal  abstraction 
model  is  determined  by  either  1)  minimizing  the  number  of  behavioral  abstraction 
methods  to  be  used  for  real-time  simulations,  2)  minimizing  quality  loss  of  the  base 
model,  or  3)  minimizing  the  number  of  behavioral  abstraction  methods  and  quality 
loss  for  real-time  simulations,  all  of  which  must  be  achieved  while  still  satisfying  a 
given  timing  constraint. 


CHAPTER  7 
CONCLUSIONS 


In  this  dissertation,  we  presented  a  modeling  methodology  for  real-time  simula- 
tion. We  showed  how  the  functional  and  nonfunctional  requirements  of  real-time  sys- 
tems are  efficiently  handled  in  the  model  generation  and  the  model  selection  phases. 
In  this  chapter,  we  summarize  this  dissertation,  and  discuss  our  perspective  on  its 
contributions  to  knowledge.  Finally,  we  point  to  future  research  directions. 

7.1     Summary 

Real-time  systems  differ  from  traditional  data  processing  systems  in  that  they  are 
constrained  by  certain  non-functional  requirements  (e.g.,  timing  constraints).  Two 
design  activities  were  defined  to  model  real-time  systems:  logical  design  activity  to 
handle  the  functional  requirements,  and  the  physical  design  activity  to  handle  non- 
functional requirements. 

Chapter  3  showed  our  model  generation  methodology  to  perform  the  logical  de- 
sign activity  of  real-time  systems.  The  model  generation  methodology  employed 
abstraction  as  a  way  of  capturing  the  functional  requirements  inherent  to  real-time 
systems.  Two  types  of  abstraction  are  performed:  structural  and  behavioral  abstrac- 
tion. Structural  abstraction  focuses  on  the  structure  of  the  model;  Modelers  define 
the  levels  of  abstraction  by  choosing  proper  model  types.  Selective  refinements  can 
occur  to  any  level  by  using  either  heterogeneous  model  types  or  homogeneous  model 
types,  depending  on  the  characteristics  of  the  level.  The  resulting  hierarchical  struc- 
ture becomes  the  base  model  that  simulates  the  system  at  the  highest  detail.  The 
behavioral  abstraction  process  addresses  the  behavior  of  the  system;  a  structural  ab- 
straction model  is  replaced  by  a  model  which  is  more  generic,  but  which  produces 

106 


107 


similar  behavior.  By  applying  behavioral  abstraction  to  the  levels  of  the  base  model, 
each  abstraction  level  becomes  independent  from  the  rest  of  the  hierarchy,  unlike 
traditional  hierarchical  modeling  methodologies.  Simulations  can  occur  at  any  ran- 
dom level  of  the  abstraction  hierarchy;  a  higher  abstraction  level  takes  less  simulation 
time  than  a  lower  abstraction  level.  Therefore,  our  model  generation  methodology 
enhances  traditional  hierarchical  modeling  approaches  [39,  58]. 

In  Chapter  4,  we  showed  how  to  perform  the  physical  design  activity  in  order  to 
achieve  the  given  timing  constraints.  The  basic  idea  was  to  control  the  abstraction 
level  with  which  the  base  model  would  be  simulated  by  the  given  deadline.  The 
optimal  abstraction  level  is  expected  to  deliver  simulation  results  by  the  given  amount 
of  time,  while  minimizing  the  quality  loss  of  the  base  model.  We  presented  the  AT 
structure  to  determine  the  execution  time  and  quality  loss  of  the  base  model  under 
the  assumption  that  the  execution  time  and  precision  loss  of  each  method  in  the  base 
model  are  properly  assessed  by  the  time  estimation  methods  and  validation  techniques 
available  in  the  literature.  Three  selection  methods  were  presented  to  find  the  optimal 
abstraction  level:  IP1,  IP2,  and  Search-based  approach.  The  selection  methods  find 
the  place(s)  where  the  use  of  behavioral  abstraction  is  expected  to  minimize  1)  the 
number  of  behavioral  abstraction  methods  (the  loss  of  the  base  model  structure),  and 
2)  the  quality  loss  of  the  base  model.  Unnecessary  structural  details  are  ignored  to 
save  simulation  time.  Therefore,  the  selected  model  is  useful  not  just  because  it  meets 
a  given  deadline,  but  also  because  it  suggests  a  structure  with  which  modelers  can 
view  the  system  in  a  given  time-constraint  situation. 

In  Chapter  5  and  Chapter  6,  we  illustrated  our  methodology  with  an  actual  appli- 
cation, FULTON  (a  steamship  modeling)  and  APPLESNAIL  (a  population  modeling 


108 


of  apple  snails).  Heterogeneous  models  were  developed  for  each  component  of  FUL- 
TON and  APPLESNAIL  by  efficiently  capturing  different  characteristics  of  each  com- 
ponent. The  base  model  of  FULTON  and  APPLESNAIL  incorporated  heterogeneous 
models  together  under  one  structure.  Box-Jenkins  behavioral  abstraction  models  were 
developed  to  save  simulation  time.  The  quality  loss  and  the  execution  time  of  the  base 
model  were  assessed  on  the  AT  structure.  Three  selection  methods  were  performed 
to  find  the  optimal  abstraction  level  for  the  given  deadlines.  Selections  were  made 
either  by  1)  minimizing  the  number  of  behavioral  abstraction  methods  (maximizing 
the  the  number  of  structural  abstraction  methods),  or  2)  minimizing  the  quality  loss, 
all  of  which  must  be  achieved  while  still  satisfying  a  given  timing  constraint. 

7.2     Contribution  to  Knowledge 

The  main  contribution  from  our  research  is  that  we  provide  a  way  of  handling 
real-time  constraints  to  the  Simulation  group,  with  the  ability  to  1)  model  the  given 
system  with  the  enhanced  hierarchical  modeling  methodology,  and  2)  select  an  opti- 
mal model  for  a  given  deadline.  Our  claim  is  not  that  OOPM/RT  should  completely 
replace  all  other  forms  of  time-handling  methodologies  in  simulation  literature,  but 
that  this  approach  be  used  in  conjunction  with  already  existing  modeling  approaches, 
especially  hierarchical  modeling  methodologies.  We  hope  that  the  research  described 
in  this  dissertation  could  also  contribute  to  other  knowledge  fields,  such  as  Real-Time 
Scheduling,  and  Real-Time  Artificial  Intelligence. 
Real-Time  Scheduling 

There  are  some  situations  where  sacrificing  solutions  are  acceptable  as  long  as 
the  overall  accuracy  loss  is  tolerable.  Image  processing  and  tracking  are  examples  of 
real-time  applications  where  users  may  accept  timely  approximate  results:  Frames  of 
fuzzy  images  and  rough  estimates  of  location  produced  in  time  may  be  better  than 
perfect  images  and  accurate  location  data  produced  too  late.    Most  algorithms  in 
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Real-Time  Scheduling  ignore  lower  priority  tasks  if  more  tasks  exist  than  the  system 
can  process  for  a  given  time.  However,  if  sacrificing  solutions  are  acceptable,  we 
may  accomplish  the  timing  constraints  if  less  accurate  (therefore,  faster  execution 
time)  tasks  are  employed,  rather  than  completely  ignoring  lower  priority  tasks.  Our 
methodology  helps  Real-Time  Scheduling  to  model  the  real-time  applications  where 
sacrificing  solutions  are  acceptable. 

We  showed  how  the  task  generation  step  reduced  the  complexity  of  the  scheduling 
process;  OOPM/RT  constructs  a  base  model  that  can  be  executed  within  a  different 
amount  of  time,  according  to  a  level  of  abstraction.  The  scheduling  algorithms  of 
OOPM/RT  directly  use  this  feature  and  control  the  level  of  abstraction  as  a  source 
of  handling  timing  constraints.  One  of  the  problems  in  Real-Time  scheduling  is  the 
lack  of  well-defined  task  generation  methods.  We  expect  that  our  model  generation 
method  can  help  Real-Time  Scheduling  group  to  efficiently  construct  task  sets;  as  a 
result,  the  complexity  of  scheduling  algorithms  can  be  reduced  due  to  the  efficiency 
of  task  sets.  Also,  we  showed  how  two  conflict  resources  -  time,  and  quality  -  are 
considered  together  in  a  way  to  maximize  the  tradeoffs.  Our  scheduling  methodologies 
can  provide  a  source  of  1)  considering  multiple  factors  in  the  scheduling  process  to 
meet  not  only  the  timing  constraints,  but  also  the  given  simulation  objective,  and 
2)  designing  a  priority  scheme  where  two  conflicting  resources  could  be  considered 
together. 

Real-Time  Artificial  Intelligence 

The  iterative  refinement  algorithms  in  Real-Time  A.I  are  expected  to  work  effec- 
tively in  all  environmental  situations.  However,  when  we  model  complex  systems,  it 
might  be  very  difficult  to  develop  a  comprehensive  multipurpose  iterative  algorithm 
to  cover  all  different  environmental  situations.  OOPM/RT  captures  the  system  with 
different  perspectives.  OOPM/RT  selection  algorithms  determine  an  optimal  model 
that  simulates  the  system  at  the  right  level  of  abstraction  for  a  specific  time-constraint 
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situation;  an  optimal  model  cuts  out  less  important  structural  information  and  sug- 
gests a  view  to  look  at  the  system  for  a  given  time-constraint  situation.  We  hope 
our  approach  could  provide  a  source  of  handling  different  environmental  situations  in 
Real-Time  A.I. 

The  model  generation  methodology  discussed  in  Chapter  3  describes  a  system 
with  different  model  types.  Modelers  are  not  forced  to  use  one  universal  modeling 
language;  instead,  they  are  encouraged  to  represent  their  knowledge  about  the  system 
with  their  familiar  model  types.  The  decision  about  the  proper  model  type  is  made 
by  the  nature  of  the  system;  for  instance,  if  the  system  has  distinct  states  and  state 
transitions,  it  is  well  represented  with  an  FSM  without  causing  problems  which  might 
arise  from  attempts  to  model  the  structure  with  unnatural  knowledge  representation 
frame,  such  as  Queuing  models.  The  structural  abstraction  process  provides  a  mor- 
phism  where  different  representations  are  allowed  in  one  abstraction  hierarchy.  The 
behavioral  abstraction  process  is  applied  on  the  abstraction  hierarchy  to  modulize 
the  knowledge  about  the  system.  Each  level  of  the  abstraction  hierarchy  becomes  an 
independent  unit  with  which  simulations  can  be  done  without  requiring  the  detailed 
structural  information  associated  with  the  rest  of  the  hierarchy.  Also,  the  simulation 
time  of  each  modulized  knowledge  is  inferred  from  the  level  of  abstraction  where  the 
knowledge  is  located;  the  knowledge  at  a  lower  abstraction  level  takes  more  time 
than  the  knowledge  at  a  higher  abstraction  level.  We  hope  that  our  model  generation 
methodology  provides  some  insights  for  making  knowledge  representation  structures 
for  real-time  systems,  where  both  timing  information  and  the  knowledge  about  the 
systems  themselves  are  efficiently  represented. 

7.3     Future  Research 

There  are  many  areas  that  we  have  not  addressed  in  much  depth  in  this  disserta- 
tion. In  this  section,  we  will  discuss  possible  directions  for  future  research  to  improve 
this  dissertation. 
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7.3.1     Behavioral  Abstraction  Process 

The  main  drawback  of  our  methodology  is  that  the  development  cost  of  good 
behavioral  abstraction  method  is  very  expensive.  Exhaustive  trial  and  errors  were 
needed  until  we  found  a  good  approximation  results.  The  behavioral  abstraction 
process  can  be  greatly  enhanced  by  : 

•  Constructing  good  training  data  sets 

•  Selecting  the  best  model  structure  that  the  behavior  of  the  training  data  sets 
are  well  abstracted 

•  Generating  the  best  accurate  model  in  which  the  approximation  is  likely  to  work 
well  for  general  cases 

We  generated  training  samples  from  simulations  of  the  base  model.  The  training 
data  sets  were  determined  manually  by  identifying  the  input  and  output  responses 
that  modelers  were  interested  in.  The  alternative  to  building  the  training  set  is  to 
use  experimental  design  techniques.  Rather  than  a  random  selection,  the  training 
values  are  chosen  according  to  a  factorial  designs;  this  aims  at  reducing  the  number 
of  simulation  runs  to  perform.  Also,  the  experimental  design  can  help  to  validate 
the  generated  behavioral  abstraction  method;  through  the  validation  process,  the 
precision  loss  of  a  behavioral  abstraction  method  can  be  well-assessed  enough  to  be 
generalized  to  all  situations. 

The  type  of  behavioral  abstraction  model  was  determined  manually;  modelers 
find  the  best  accurate  model  structure  by  exhaustive  experimentations.  A  decision 
supporting  tool  is  useful  in  aiding  the  selection  of  the  behavioral  abstraction  model. 
The  behavioral  abstraction  process  is  equivalent  to  the  metamodeling  process,  as  dis- 
cussed in  Chapter  3.  Figure  7.1  shows  a  decision  sequence  which  is  defined  to  perform 
the  selection  of  metamodel  type  [12].  The  purpose  of  the  procedure  is  to  match  the 
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problem  definition  and  objectives  of  the  simulation  to  the  behavior  allowed  by  the 
metamodel  set  (behavioral  abstraction  model  set).  By  using  a  decision  supporting 
tool  to  guide  the  defined  procedure,  we  can  help  a  modeler  to  find  out  the  best  model 
structure  for  the  training  data. 

Learning  parameters  of  the  behavioral  abstraction  techniques  were  determined 
by  trial  and  errors  until  the  desirable  results  were  achieved.  There  are  some  useful 
information  to  aid  this  process;  For  example,  the  weights  and  biases  of  linear  net- 
works (e.g.,  ADALINE)  that  minimize  the  sum  of  the  squared  error  of  the  network 
can  be  found  directly  if  all  of  the  input  vector/  target  vector  pairs  are  known  [43]. 
When  this  kind  of  information  is  available,  we  can  implement  this  information  in  a 
decision  supporting  tool.  By  having  proper  experimental  design  techniques  and  a 
decision  supporting  tool  discussed  in  this  section,  the  behavioral  abstraction  process 
can  be  greatly  enhanced. 
7.3.2     Quality  Assessment 

One  of  our  assumptions  was  that  the  quality  and  execution  time  of  each  ab- 
straction method  are  fairly  predictable.  In  general,  predicting  the  execution  time 
can  be  made  precisely,  by  using  the  available  runtime  estimation  techniques  [60,  61]. 
However,  expecting  the  method's  quality  is  difficult.  Even  though  the  quality  is  well- 
assessed  for  each  method,  the  assessed  quality  might  be  influenced  by  other  methods, 
for  instance,  when  the  result  from  a  method  decreases  (hinders)  the  quality  of  other 
methods,  or  the  result  from  a  method  increases  (facilitates)  the  quality  of  other  meth- 
ods [2]. 

One  possible  solution  is  to  monitor  the  execution  and  quality  loss  of  the  model 
under  real-time  simulations.  When  the  selected  model  takes  a  longer  time  than  ex- 
pected, or  the  solution  quality  is  lower  than  expected  during  the  real-time  simulation, 
it  is  reported  to  the  monitor.  Then,  the  appropriate  actions  can  be  taken  to  adjust 
the  problems  that  have  been  caused  by  the  under-estimated/over-estimated  duration 
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or  quality  [1].  Another  solution  might  be  to  use  the  least  detailed  model  as  a  fallback 
method;  we  always  prepare  the  least  detailed  model  (the  fastest  model)  as  the  fall- 
back method.  The  fallback  method  replaces  the  selected  model  when  an  unexpected 
emergency  situation  (violation  of  timeliness  due  to  under-estimated  execution  time) 
occurs  [2].  In  this  case,  the  selection  algorithm  finds  an  optimal  model  with  the  tim- 
ing constraint,  deadline  —  D(m),  where  D(m)  is  the  duration  to  execute  the  least 
detailed  model. 

7.4     Conclusions 

We  demonstrated  a  semi-automated  methodology  to  build  a  model  that  is  right 
for  the  simulation  objective  and  real-time  constraints.  The  key  to  our  method  is 
to  use  the  model  abstraction  technique  to  generate  multiple  methods  of  the  system 
that  involve  tradeoffs  in  runtime  versus  accuracy.  Modelers  construct  the  abstrac- 
tion hierarchy  through  a  structural  abstraction  phase.  Heterogeneous  model  types 
are  employed  to  efficiently  capture  various  characteristics  and  different  environmen- 
tal situations  of  the  system.  We  use  the  abstraction  hierarchy  for  the  source  of 
information  where  the  optimal  abstraction  degree  is  determined.  By  applying  the 
model  selection  algorithms  that  determine  the  optimal  abstraction  level  to  simulate 
the  system  for  a  given  deadline,  we  find  position(s)  where  the  behavioral  abstraction 
technique  is  applied.  Behavioral  abstraction  saves  time  in  simulation  by  discarding 
detailed  structural  information,  though  accuracy  is  sacrificed.  The  determined  model 
simulates  the  system  at  an  optimal  level  of  abstraction  to  satisfy  the  simulation  object 
for  a  given  deadline,  while  maximizing  the  tradeoff  model  execution  time  for  quality. 
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Figure  7.1.  Metamodeling  set  determination  and  taxonomy  of  metamodel  methods 


114 


APPENDIX  A 
EXAMPLE  ABSTRACTION  OF  BOILING  WATER 


In  this  chapter,  we  illustrate  the  performance  of  the  behavioral  abstraction  tech- 
niques through  "Boiling  water"  example.  "Boiling  water"  example  illustrates  how 
the  behavioral  abstraction  techniques  perform  in  approximating  a  non-linear  system 
as  in  differential  equations. 

Consider  the  pot  of  water  in  Figure  A.l.  Figure  A.l  shows  a  trajectory  of  input 
and  output  signal.  The  input  reflects  the  state  of  the  knob,  which  serves  to  specify 
external  events  for  the  system.  The  output,  T,  defines  the  temperature  of  the  water 
over  time.  Let's  define  the  thermal  resistance  R  =  H/kA(¥{  is  the  height  of  water, 
A  is  the  surface  area  of  the  pot,  and  k  is  the  thermal  conductivity  of  water)  We 
will  ignore  the  resistance  of  the  pot  since  it  is  not  as  significant  as  the  resistance  of 
water.  The  definition  for  thermal  capacitance  C  is  CT  =  q^  with  q^  being  the  flow 
of  heating  element  to  the  water,  and  C  be  the  total  capacitance.  Newton's  law  of 
cooling  states  that  Rq^  =  AT  —  7\  —  T2  where  7\  is  the  temperature  of  the  source 
(heating  element),  and  T2  is  the  temperature  of  the  water,  q^  is  heat  flow.  Since  T2 
is  our  state  variable  we  let  T  =  T2  for  convenience.  By  combining  Newton's  law  with 
the  capacitance  law,  and  using  the  law  of  capacitors  in  series,  we  arrive  at: 

k    _     C1  +  C2  ^j 

RC1C2 
f    =    fe(Ti  -  T)  (A. 2) 

A.l     Structural  Abstraction 

The  structural  approach  to  system  abstraction  for  the  boiling  water  is  defined  in 

a  recent  text  [15]  where  the  boiling  water  is  included  as  a  sub-system  within  a  system 

of  two  flasks  and  a  human  operator  who  mixes  the  flasks  once  the  liquids  are  boiling. 
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Figure  A.l.  Boiling  water  system 

In  the  structural  abstraction  approach  to  systems,  we  first  need  to  define  our  levels  of 
abstraction  and  then  choose  which  models  types  to  use  at  each  level.  In  [33,  34,  15], 
we  have  the  following  model  levels: 

1.  Level  1:   Petri  net,  defines  the  action  of  the  human  operator  and  the  mixing 
process. 

2.  Level  2:  FSA  (Finite  State  Automaton),  defines  the  phases  of  water  during  heat- 
ing and  cooling. 

(a)  Sub-level  2.1:  FSA,  defines  two  states:  cold  and  not  cold. 

(b)  Sub-level  2.2:  FSA,  defines  four  states  underneath  not  cold:  heating,  cool- 
ing, boiling  and  exception. 

(c)  Sub-level  2.3:  FSA,  defines  two  states  underneath  exception:  overflow  and 
underflow. 
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Figure  A. 2.  3  level  FS  for  the  boiling  water  multimodel 

3.  Level  3:  Code  model,  defines  Newton's  Law  of  Cooling  subdefining  both  cooling 
and  heating  phases. 

For  the  FSA  in  Figure  A. 2  we  choose  to  represent  each  state  as  a  continuous 
model.  Specifically,  each  state  will  define  how  three  state  variables,  T(Temperature), 
Hw (height  of  water),  and  ///(height  of  foam  on  the  top  of  the  water)  are  updated. 
Also  the  parameter  Ht  is  the  height  of  the  pot.  /  indicates  knob's  position  and  a  is 
the  ambient  temperature  of  the  water.  Figure  A. 3  shows  Newton's  law  of  cooling  in 
a  functional  block  form.  □ 


A.2     Behavioral  Abstraction 

Using  the  base  model  which  has  been  constructed  from  the  structural  abstraction 
process,  we  illustrate  how  behavioral  abstraction  techniques  perform  in  an  actual 
application. 
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Figure  A. 3.  Decomposition  of  Heating  state 

In  the  static  approach,  we're  interested  only  in  the  final  (i.e.,  steady  state)  tem- 
perature of  the  water.  A  trajectory  of  final  temperature  of  the  water  is  obtained  by 
varying  total  amount  of  simulation  time.  Figure  A. 4  shows  final  temperature  versus 
simulation  elapsed  time.  This  information  is  obtained  directly  from  the  underlying 
simulation  of  the  boiling  water  system.  We  chose  a  subset  of  all  possible  input  time 
trajectories  in  such  a  way  that  some  nonlinearity  was  introduced  into  the  graph  in 
Figure  A. 4.  This  was  done  to  challenge  the  behavioral  parameter  estimation  meth- 
ods in  creating  a  good  fit.  This  explains  why  Figure  A. 4  contains  a  small  area  of 
discontinuity  in  the  region  between  steady  state  temperature  values  of  20  and  40. 
We  approximate  final  temperature  by  integral  value  of  knob's  On/Off  trajectory  over 
simulation. 
A.2.1     Linear  Regression 

In  general,  a  polynomial  fit  to  data  in  vectors  x  and  y(x:input,  y:output)  is  a 
function,  p,  of  the  form: 


p(x)  =  cxxn  +  c2xn      +  ...  +  cd 


(A.3) 
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Figure  A. 4.  Elapsed  time  vs.  Temperature 

The  degree  is  n  and  the  number  of  coefficients  is  d  =  n+1.  The  coefficients  c\,  C2, ...,  cn 

are  determined  by  solving  a  system  of  simultaneous  linear  equation:  Ac  =  y,  where 

A  is  matrix  whose  columns  are  successive  powers  of  the  x  vector.  Figure  A.5-a  shows 

the  result.    The  approximation  is  poor  in  the  graph's  central  region  because  linear 

regression  is  done  by  polynomial  fit,  and  so  it  generates  a  monotonically  increasing 

function. 

A. 2.2     Backpropagation  Network 

One  of  the  traditional  uses  of  a  neural  network  is  function  approximation.  The 
typical  two  layer  architecture  used  for  a  function  approximation  network  has  two 
different  transfer  functions  for  layers:  a  sigmoid  transfer  function  for  the  hidden  layer 
and  a  linear  transfer  function  for  the  output  layer.  One  hidden  layer  of  sigmoidal 
neurons  receives  inputs  directly  from  the  input  layer  and  then  broadcast  their  outputs 
to  a  layer  of  linear  neurons,  which  compute  the  network  output  [57,  54].  Figure  A.5-b 
shows  the  approximation  result.  This  also  shows  poor  performance  in  abstracting  the 
sharp  changing  part  like  the  linear  regression  model. 

In  the  next  subsequent  sections,  we  illustrate  dynamic  behavioral  abstraction  tech- 
niques. 
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(a)  Linear  Regression 


(b)  Backpropagation  neural  network 


Figure  A. 5.  Static  behavioral  abstraction  for  Boiling  Water  example 

A.2.3     System  Identification 

The  Box-Jenkins  method  is  a  frequently  used  system  identification  method  in  time 
series  analysis  [50,  51,  43].  Its  structure  is  given  by 


B(q)    .  ,,       C(q)    ,  , 

y(t)  =  -p^-uit  -  nk)  +  -=^re(t) 


F(q) 


D{q) 


(A.4) 


with 


y(t) 

B(q) 

F{q) 
C{q) 
D(q) 


outputsignal 

bx  +  b2q-1  +  ...  +  bnbq-nb 

l  +  fiq-1  +  ...  +  fnfq-nf 
1  +  dq-1  +  ...  +  cncq-nc 
1  +  drf'1  +  ...  +  dndq-nd 


The  numbers  nb,  nc,  nd  and  nf  are  the  orders  of  the  respective  polynomials  and  q 
is  the  shift  operator.  The  number  nk  is  the  number  of  delays  from  input  to  output. 
Figure  A. 6  shows  the  approximation  result.  Successful  identification  of  y(t)  depends 
on  how  well  we  guess  the  values  of  nb,  nc,  nd,  nf  and  nk.   Heuristics  and  "expert 
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rules,"  if  available,  aid  us  in  choosing  parameters.    For  example,  too  large  a  value 
for  a  parameter  results  in  computational  difficulties  to  generate  y(t),  while  too  small 
a  value  results  in  a  rough  estimation.  We  often  had  to  tune  parameters  by  hand  in 
order  to  get  a  good  approximation. 
A.2.4     ADALINE  Neural  Network 

ADALINE  was  developed  by  Widrow  and  Hoff  [72].  Their  neural  network  model 
differs  from  the  perceptron  [54]  in  that  ADALINE  neurons  have  a  linear  transfer 
function.  The  ADALINE  network  also  enables  the  Widrow-Hoff  learning  rule,  known 
as  the  Least  Mean  Square(LMS)  rule,  to  adjust  weights  and  biases  according  to  the 
magnitude  of  errors.  Figure  A. 7  shows  the  output  signal  of  the  linear  neuron  with 
the  target  signal.  An  ADALINE  neural  network  takes  initial  weights  and  biases,  an 
input  signal  and  a  target  signal,  and  then  filters  the  signal  adaptively  based  on  input 
delay  and  learning  rate  parameters.  In  most  cases,  input  delay  can  be  guessed  by  the 
modeled  system  itself.  For  boiling  water  example,  we  know  an  output  at  time  t  is 
determined  by  2  most  recent  inputs.  However,  choosing  an  appropriate  learning  rate 
can  not  be  implied  by  the  modeled  system  itself,  but  through  trial  and  error.  Too 
large  a  learning  rate  results  in  a  rough  estimation,  while  too  small  a  value  results 
in  severe  perturbations  during  the  learning  stage.  We  use  linear  transfer  function  to 
calculate  the  output  of  the  ADALINE  neural  network.  Unlike  the  ordinary  ADALINE 
neural  network,  we  can  specify  delay  to  compose  input  temporal  segment. 
A. 2.5     Gamma  Network 

The  Gamma  network  can  be  regarded  as  an  extension  of  the  Multilayer  Percep- 
tron (MLP)  [54].  It  includes  memory  structures  which  allow  temporal  patterns  to  be 
converted  into  static  input  patterns.  A  Gamma  network  focuses  on  the  network  archi- 
tecture whose  memory  structures  are  implemented  only  at  the  input  layer  to  alleviate 
the  difficulty  in  determining  the  memory  order  [73,  74].  The  abstraction  result  for  the 
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(a)  Box-Jenkins  method  for  Boiling  Water 
Example 


(b)  Abstraction  error  in  Box-Jenkins  method 


Figure  A. 6.  Box-Jenkins  Behavioral  Abstraction 


Gamma  network  is  shown  in  Figure  A. 8.  A  Gamma  network  takes  a  number  of  hidden 
nodes,  the  order  of  gamma  memory,  and  number  of  steps  for  both  feed-forwarding 
and  back-propagation  as  parameters.  Due  to  the  absence  of  a  systematic  approach, 
parameters  must  be  adjusted  manually  to  accomplish  a  good  abstraction  result.  □ 
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(a)  ADALINE  network  for  Boiling  Water  Ex- 
ample 


(b)  Abstraction  error  in  ADALINE  network 


Figure  A. 7.  ADALINE  Neural  Network  Behavioral  Abstraction 
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(a)  Gamma  network  for  Boiling  Water  Exam- 
ple 
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(b)  Abstraction  error  in  Gamma  network 


Figure  A. 8.  Gamma  Neural  Network  Behavioral  Abstraction 


APPENDIX  B 
EXAMPLE  ABSTRACTION  OF  HEMATOPOIESIS 


There  are  many  acute  physiological  diseases  where  the  initial  symptoms  are  man- 
ifested by  an  alteration  or  irregularity  in  a  control  system  which  is  normally  periodic, 
or  by  the  onset  of  an  oscillation  in  a  hitherto  non-oscillatory  process.  Such  physio- 
logical diseases  have  been  termed  dynamic  diseases  by  Glass  and  Mackey  [75]. 

Our  model  deals  with  the  regulation  of  hematopoiesis,  the  formation  of  blood  cell 
elements  in  the  body.  Hematopoiesis  is  the  process  of  blood  creation  in  the  body. 
White  and  red  blood  cells  are  produced  in  the  bone  marrow.  From  the  marrow  they 
enter  the  blood  circulatory  system.  As  the  oxygen  level  decreases  in  the  body,  there  is 
a  feedback  to  the  bone  marrow,  which  in  turn  produces  more  cells.  "Hematopoiesis" 
example  illustrates  the  approximation  performance  on  delayed  differential  equations. 

B.l     Structural  Abstraction 

Mackey  and  Glass  [76]  provide  a  delay  model  for  hematopoiesis  of  the  following 
form: 

at       e™  +  p™(t-T)    9  {)  (     ' 

where,  A  :  the  flux  of  cells  into  the  blood  stream,  P(t)  :  the  concentration  of 
cells(the  population  species)  in  the  circulating  blood  (cells/mm3),  g  :  day-1,  cell  loss 
rate  per  day,  9  :  positive  constant  and  T  :  maturation  delay. 

Difference  and  differential  equations  are  often  used  in  simulation  to  model  low 
level  phenomena.  While  the  hematopoiesis  process  can  be  modeled  with  the  usual 
differential  equation  techniques,  we  need  a  method  for  incorporating  the  delay  T 
between  the  initialization  of  cellular  production  in  the  bone  marrow  and  the  release 
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1  1.5 
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(a)  Cell  concentration  vs.  time  for  delay  T  = 
6  days 


(b)  Cell  concentration  vs.  time  for  delay  T 
20  days 


Figure  B.l.  Cell  concentration  for  different  delay  T 

of  mature  cells  into  the  bloodstream,  since  a  state  variable's  value  will  stay  fixed  for 
a  time  period.  We  use  A  as  an  input.  Depending  on  the  maturation  delay  T,  we 
can  generate  different  solutions.  Figure  B.l  displays  the  time  trajectory  for  the  total 
concentration  of  blood  cells  between  times  0  to  600  when  the  delay  T  =  6  days.  As  the 
delay  moves  upward  to  T  =  20  days,  we  find  a  nonperiodic  trajectory  in  Figure  B.l. 
Since  we  are  interested  in  abstracting  the  time  dependent  behavior  of  cell  con- 
centration in  the  circulating  blood,  we  will  restrict  out  experiments  to  dynamic- 
behavioral  abstractions.  Also,  to  see  how  abstraction  techniques  perform  under  heavy 
nonperiodic  and  nonlinearity,  we  choose  maturation  delay  20.  Now,  the  dynamic- 
behavioral  abstraction  of  hematopoiesis  model  is  to  approximate  equation  (B.l)  with 
a  discrete  model  of  the  form 


P(t)    =    f(P(t-l),...,P(t-na)) 


where  /  is  a  nonlinear  function  to  be  estimated  with  order  na. 
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Figure  B.2.  Hematopoiesis  model  for  delay  =  20  days  with  increased  sampling  period: 
abstraction  target 


A  small  sampling  period  for  the  discretization  makes  the  order  of  the  discrete 
model  very  high  due  to  the  long  dependence  of  P(t)  on  P(t  —  20),  which  results  in 
numerical  difficulties  to  compute  the  optimal  function  of  /.  Therefore,  increasing  the 
sampling  period  is  needed,  as  long  as  the  discretization  is  not  too  rough.  Figure  B.2 
displays  the  time  trajectory  for  the  total  concentration  of  blood  cells  when  the  sam- 
pling period  is  increased  by  100,  which  introduces  more  nonlinearity  and  instability. 
We  choose  Figure  B.2  as  the  abstraction  target  and  use  A  for  input. 

Structural  abstraction  can  be  defined  by  a  phase  graph  depicting  P(t)  against 
P(t  —  20)  as  shown  in  Figure  B.3. 

The  behavior  of  the  system  can  be  divided  into  two  phases:  OUTSIDE_ATTRACTOR 
and  INSIDE_ATTRACTOR.  The  concept  of  basins  of  attraction  is  a  well-formed  con- 
cept in  nonlinear  dynamics.  In  OUTSIDE_ATTRACTOR,  the  system  shows  an  ap- 
proximately linear  behavior,  while,  in  the  INSIDE_ATTRACTOR,  chaotic  behavior 
appears  in  the  sense  that  solution  pattern  is  not  repetitive  in  any  regular  way.  Based 
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Figure  B.3.  Phase  graph  for  delay  T=20  days 

on  this  observation,  we  define  structural  abstraction  of  the  hematopoiesis  model  at 
the  following  two  levels. 

•  Level  1:    FSA  net,  defines  the  chaotic  behavior  of  the  system  by  two  phases, 
OUTSIDE_ATTRACTOR  and  INSIDE_ATTRACTOR 

•  Level  2:  Equation  model,  subdefines  both  OUTSIDE_ATTRACTOR  and 
INSIDE_ATTRACTOR  phase  by  equations. 

In  [15]  we  describe  a  method  for  determining  the  boundary  of  an  attractor  basin  for  a 
pendulum  with  Hamiltonian  dynamics.  Other  methods  also  exist  for  approximating 
the  boundary  geometry.  For  this  problem,  we  will  assume  that  the  boundary  has 
been  calculated  by  one  of  these  means.  The  top  level  of  Figure  B.4  shows  FSA  net 
for  Levell.  Transition  fires  when  predicate  p  becomes  true,  p  is  defined  to  be  true 
when  the  phase  point  p(t),p(t  —  20)  is  within  the  attractor  and  p  is  otherwise  false. 
We  use  equation  (B.l)  for  the  subdefinition  of  both  OUTSIDE_ATTRACTOR  and 
INSIDE_ATTRACTOR. 
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',    p(P(l),P(t-20)) 


Mackey  &  Glass 
Equation 


Mackey  &  Glass 
Equation 


Figure  B.4.  Structural  abstraction  of  hematopoiesis  model 

B.2     Behavioral  Abstraction 

Since  we  are  interested  in  abstracting  the  time  dependent  behavior  of  cell  con- 
centration in  the  circulating  blood,  we  will  restrict  out  experiments  to  dynamic- 
behavioral  abstractions.  Also,  to  see  how  abstraction  techniques  perform  under  heavy 
nonperiodic  and  nonlinearity,  we  choose  maturation  delay  20.  Now,  the  dynamic- 
behavioral  abstraction  of  hematopoiesis  model  is  to  approximate  equation  (B.l)  with 
a  discrete  model  of  the  form 


P(t)  =  f(P(t-l),...,P(t-na)) 

where  /  is  a  nonlinear  function  to  be  estimated  with  order  na. 
B.2.1     System  Identification 

A  commonly  used  parametric  model  is  the  ARX  model  : 

y(t)  +  a!y{t  -  1)  +  ...  +  anay{t  -  na)  = 


(B.2) 


(B.3) 


b\u{t  —  nk)  +  b2u(t  —  nk  —  1)  +  ... 
...  +  bnbu(t  —  nk  —  nb  +  1)  +  e(£) 

Variables  na  and  nb  are  the  orders  of  the  respective  polynomials.     The  number 
nk  is  the  number  of  delays  from  input  to  output.    We  attempted  to  abstract  the 
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(a)  ARX  model  for  hematopoiesis  model 


(b)  Abstraction  error  in  ARX  model 


Figure  B.5.  ARX  behavioral  abstraction  for  hematopoiesis  model 

hematopoiesis  model  with  a  linear  ARX  model  by  varying  na,  nb  and  nk,  but  the 
results  were  not  satisfactory  as  shown  in  Figure  B.5.  Nonlinear  model  representation 
is  necessary  to  achieve  an  accurate  performance. 
B.2.2     ADALINE  neural  network 


We  mentioned  the  general  structure  and  characteristics  of  the  ADALINE  neural 
network  in  section  3.2.2.  The  ADALINE  neural  network  for  the  hematopoiesis  model 
performs  abstraction  as  shown  in  Figure  B.6.  Like  the  ADALINE  abstraction  for 
the  boiling  water  example,  the  input  delay  of  20  is  inferred  by  the  delay-differential 
equation  B.l.  A  proper  learning  rate  is  determined  by  repetitive  trials  until  a  good 
fit  is  achieved  with  fewer  learning-stage  perturbations. 
B.2.3     WAVELET  network 

We  use  Zhang's  wavelet  networks  [55],  whose  purpose  is  to  approximate  ARX 
model  structure(equation  (B.3))  with  wavelets.  Abstraction  depends  on  a  good  guess 
of  na,  nb,  nk  and  the  number  of  wavelons.  Figure  B.7  shows  the  abstraction  result 
with  the  wavelet  network.    The  use  of  the  wavelet  and  recurrent  neural  networks 
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(a)  ADALINE  model  for  hematopoiesis  model 


(b)  Abstraction  error  in  ADALINE  network 


Figure  B.6.  ADALINE  behavioral  abstraction  for  hematopoiesis  model 

improve  the  abstraction  result  comparing  to  the  linear  ARX  model.  Especially,  the 
ADALINE  network  performs  especially  well  in  our  example,  since  the  parameters 
it  needs  can  be  decided  directly  from  the  delay-differential  equation  (B.l).  Other 
methods  require  parameter  tuning  by  hand  to  locate  correct  values  that  cannot  be 
inferred  from  the  modeled  system  itself.  □ 


(a)  Wavelet  network  for  hematopoiesis  model 


(b)  Abstraction  error  in  Wavelet  network 


Figure  B.7.  Wavelet  behavioral  abstraction  for  hematopoiesis  model 
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